2020-04-02T22:52:15.413 INFO:root:teuthology version: 1.0.0-8191bbb 2020-04-02T22:52:15.414 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.phbnwP.tmp -- --verbose --lock --description fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_snaptests.yaml} --name gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi --block --owner scheduled_gregf@teuthology --archive /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919121 2020-04-02T22:52:15.457 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T22:52:15.529 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919121 branch: wip-greg-testing-42 description: fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_snaptests.yaml} email: gfarnum@redhat.com first_in_suite: false job_id: '4919121' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-greg-testing-42 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd mds ms inject socket failures: 2500 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - Replacing daemon mds - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: cbb84f71d70460f911296715ab61ac09c6962b17 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: cbb84f71d70460f911296715ab61ac09c6962b17 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-greg-testing-42 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 owner: scheduled_gregf@teuthology priority: 101 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 suite: fs suite_branch: wip-greg-testing-42 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cbb84f71d70460f911296715ab61ac09c6962b17 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - mds_thrash: null - ceph-fuse: null - workunit: clients: all: - fs/snaps teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.14492 2020-04-02T22:52:15.530 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa; will attempt to use it 2020-04-02T22:52:15.530 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa/tasks 2020-04-02T22:52:15.530 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-02T22:52:15.533 INFO:teuthology.task.internal:Checking packages... 2020-04-02T22:52:15.546 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'cbb84f71d70460f911296715ab61ac09c6962b17' 2020-04-02T22:52:15.546 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-02T22:52:15.546 INFO:teuthology.packaging:ref: None 2020-04-02T22:52:15.546 INFO:teuthology.packaging:tag: None 2020-04-02T22:52:15.546 INFO:teuthology.packaging:branch: wip-greg-testing-42 2020-04-02T22:52:15.546 INFO:teuthology.packaging:sha1: cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T22:52:15.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-greg-testing-42 2020-04-02T22:52:15.790 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-316.gcbb84f7 2020-04-02T22:52:15.790 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-02T22:52:15.800 INFO:teuthology.task.internal:no buildpackages task found 2020-04-02T22:52:15.800 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-02T22:52:15.814 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-02T22:52:15.815 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T22:52:15.866 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:25.884 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:35.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:45.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:55.932 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:05.950 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:15.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:25.981 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:36.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:46.019 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:53:56.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:06.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:16.069 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:26.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:36.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:46.117 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:56.135 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:55:06.149 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:55:16.158 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:55:26.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:55:36.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:55:46.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:55:56.220 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:06.237 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:16.252 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:26.273 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:36.290 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:46.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:56.327 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:06.341 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:16.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:26.374 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:36.392 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:46.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:56.426 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:06.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:16.461 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:26.477 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:36.492 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:46.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:56.524 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:06.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:16.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:26.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:36.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:46.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:56.628 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:06.646 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:16.662 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:26.678 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:36.693 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:46.709 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:56.727 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:06.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:16.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:26.781 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:36.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:46.814 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:56.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:06.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:16.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:26.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:36.911 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:46.959 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:56.974 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:06.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:16.996 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:27.014 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:37.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:47.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:57.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:07.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:17.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:27.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:37.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:47.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:57.206 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:05:07.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:05:17.231 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:27.249 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:37.267 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:47.288 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:57.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:07.316 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:17.329 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:27.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:37.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:47.376 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:57.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:07.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:17.427 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:27.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:37.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:47.469 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:57.485 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:07.500 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:17.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:27.558 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:37.577 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:47.594 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:57.608 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:07.624 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:17.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:27.646 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:37.664 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:47.676 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:57.694 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:07.712 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:17.728 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:27.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:37.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:10:47.775 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:57.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:07.807 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:17.818 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:27.835 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:37.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:47.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:57.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:12:07.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:12:17.918 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:12:27.927 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:12:37.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:12:47.961 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:12:57.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:13:07.993 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:13:18.006 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:13:28.024 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:13:38.041 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:13:48.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:13:58.074 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:08.113 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:18.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:28.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:38.162 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:48.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:58.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:08.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:18.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:28.244 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:38.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:48.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:58.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:08.319 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:18.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:28.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:38.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:48.383 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:58.401 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:08.414 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:18.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:28.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:38.460 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:48.476 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:58.494 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:18:08.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:18:18.522 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:28.537 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:38.554 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:48.568 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:58.589 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:08.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:18.621 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:28.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:38.655 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:48.679 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:58.697 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:20:08.712 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:20:18.721 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:20:28.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:20:38.748 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:20:48.764 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:20:58.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:08.794 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:18.810 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:28.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:38.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:48.864 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:58.882 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:08.896 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:18.908 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:28.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:38.932 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:48.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:58.962 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:08.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:18.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:29.010 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:39.024 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:49.042 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:59.063 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:09.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:19.096 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:29.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:39.123 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:24:49.135 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:24:59.154 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:25:09.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:25:19.188 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:25:29.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:25:39.216 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:25:49.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:25:59.249 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:26:09.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:26:19.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:26:29.305 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:26:39.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:26:49.336 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:26:59.356 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:27:09.373 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:27:19.392 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:27:29.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:27:39.424 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:27:49.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:27:59.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:28:09.472 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:28:19.488 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:28:29.505 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:28:39.514 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:28:49.532 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:28:59.549 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:29:09.570 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:29:19.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:29:29.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:29:39.610 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:29:49.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:29:59.640 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:30:09.657 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:30:19.672 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:30:30.892 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:30:40.907 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:30:50.924 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:31:00.939 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:31:10.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:31:20.974 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:31:30.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:31:41.000 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:31:51.019 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:32:01.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:32:11.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:32:21.069 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:32:31.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:32:41.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:32:51.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:33:01.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:33:11.149 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:33:21.163 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:33:31.173 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:33:41.184 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:33:51.202 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:34:01.216 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:34:11.233 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_gregf@teuthology', 'description': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919121', 'machine_type': 'smithi'} 2020-04-02T23:34:11.248 DEBUG:teuthology.lock.ops:locked ubuntu@smithi082.front.sepia.ceph.com, ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:34:11.326 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:34:11.519 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 8.1 2020-04-02T23:34:11.521 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.1 2020-04-02T23:34:11.924 INFO:teuthology.orchestra.console:Power off smithi082 2020-04-02T23:34:11.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:34:11.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:11.970 INFO:teuthology.orchestra.console:Power off smithi050 2020-04-02T23:34:11.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:34:11.991 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:15.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:16.019 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:20.093 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:20.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:20.338 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2020-04-02T23:34:20.442 INFO:teuthology.orchestra.console:Power on smithi050 2020-04-02T23:34:20.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:34:20.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:24.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:24.415 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2020-04-02T23:34:24.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:24.517 INFO:teuthology.orchestra.console:Power on smithi082 2020-04-02T23:34:24.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:34:24.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:28.561 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:28.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:34:28.770 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2020-04-02T23:34:28.808 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2020-04-02T23:34:28.871 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2020-04-02T23:34:28.909 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2020-04-02T23:37:00.422 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:09.481 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:15.511 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:18.540 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:24.587 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:27.626 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:33.638 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:36.678 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:42.695 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:45.736 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:51.752 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:37:54.794 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:38:00.810 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:38:09.865 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:38:18.922 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:38:26.630 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:38:26.983 INFO:teuthology.orchestra.run.smithi050:> hostname 2020-04-02T23:38:27.006 INFO:teuthology.orchestra.run.smithi050.stdout:smithi040 2020-04-02T23:38:27.006 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:38:27.062 INFO:teuthology.orchestra.run.smithi050:> grep smithi040 /etc/hosts 2020-04-02T23:38:27.117 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2020-04-02T23:38:27.118 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:38:27.171 INFO:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2020-04-02T23:38:27.293 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:38:27.308 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi040/smithi050/g' /etc/hosts 2020-04-02T23:38:27.386 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:38:27.440 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.40/172.21.15.50/g' /etc/hosts 2020-04-02T23:38:27.513 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:38:27.568 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi040/smithi050/g' /etc/hostname 2020-04-02T23:38:27.640 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:38:27.696 INFO:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2020-04-02T23:38:27.770 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2020-04-02T23:38:27.772 DEBUG:teuthology.parallel:result is None 2020-04-02T23:38:27.974 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:38:37.033 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:39:09.026 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:09.361 INFO:teuthology.orchestra.run.smithi082:> hostname 2020-04-02T23:39:09.416 INFO:teuthology.orchestra.run.smithi082.stdout:smithi040 2020-04-02T23:39:09.416 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:09.469 INFO:teuthology.orchestra.run.smithi082:> grep smithi040 /etc/hosts 2020-04-02T23:39:09.524 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2020-04-02T23:39:09.524 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:09.579 INFO:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2020-04-02T23:39:09.715 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:09.727 INFO:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi040/smithi082/g' /etc/hosts 2020-04-02T23:39:09.797 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:09.852 INFO:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.40/172.21.15.82/g' /etc/hosts 2020-04-02T23:39:09.919 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:09.973 INFO:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi040/smithi082/g' /etc/hostname 2020-04-02T23:39:10.041 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:10.093 INFO:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2020-04-02T23:39:10.159 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2020-04-02T23:39:10.161 DEBUG:teuthology.parallel:result is None 2020-04-02T23:39:10.278 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2020-04-02T23:39:10.279 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:39:10.295 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2020-04-02T23:39:10.295 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:39:10.309 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:39:10.310 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:39:10.376 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:10.558 INFO:teuthology.orchestra.run.smithi082:> uname -m 2020-04-02T23:39:10.609 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2020-04-02T23:39:10.610 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:10.661 INFO:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2020-04-02T23:39:10.713 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Linux" 2020-04-02T23:39:10.713 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8 (Core)" 2020-04-02T23:39:10.713 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2020-04-02T23:39:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:39:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2020-04-02T23:39:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:39:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:39:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2020-04-02T23:39:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:39:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:39:10.715 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:39:10.715 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:10.715 INFO:teuthology.orchestra.run.smithi082.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:39:10.715 INFO:teuthology.orchestra.run.smithi082.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:39:10.715 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:39:10.715 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:39:10.715 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:10.716 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2020-04-02T23:39:10.730 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:39:10.731 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:39:10.801 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:10.983 INFO:teuthology.orchestra.run.smithi050:> uname -m 2020-04-02T23:39:11.037 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2020-04-02T23:39:11.038 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:11.091 INFO:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2020-04-02T23:39:11.145 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Linux" 2020-04-02T23:39:11.146 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8 (Core)" 2020-04-02T23:39:11.146 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2020-04-02T23:39:11.146 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:39:11.146 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2020-04-02T23:39:11.146 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:39:11.146 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:39:11.146 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2020-04-02T23:39:11.147 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:39:11.147 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:39:11.147 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:39:11.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:11.147 INFO:teuthology.orchestra.run.smithi050.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:39:11.147 INFO:teuthology.orchestra.run.smithi050.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:39:11.147 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:39:11.148 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:39:11.148 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:11.148 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2020-04-02T23:39:11.162 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-02T23:39:11.195 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbmMf4jOHCgq29NGTOZJ0kVGW5vGKui1HIoOpL0hoHBwAf28qqSazK6A0Gv4Rjq/f56nA0N9p6cgNA/xSBPOFvYUdiBEYr3hJrQIw2GyhvBejxppeKtcrSX10t5qClXeQRrzAPOVTKaR/wy8Llf48wD+F0Cxh76IAlTNAiNEse1mRF7BflMzpd8a03YYPBZfbQRTdkXfuOWowMrMf0o+e4A5iY25jFts22Zb03AdzwAtyjSHIckJ1Nuh2QzowR+G6/kf87eMOFSrFSP4TXKtHCdnrIooB98jkaSV/PzXIqyEuiJOSAROE8/3/ZmpfIgZNqtSkn4BygjPlQT/JwqaL8KfaF6SMy+M0XC+SH3jAcgOxu20uXi2chaXKjDRliZDpK/HbZf3atq0sz7GxN6h4lQnR5NWMjZfiNDifAF+teJBYBLkn18f0/v/5U2skq1IU/kSR+syf9AG0uSHSemf+VWIV9vE1VqyDyYcPNw4eAbhXqy5TsYdEXoXHtw3T0yPs= smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ8kRsQ1GLiHQaqo311lNAVkRMWFnSSRqMRrN4HD18AFN9gsIwPaU/v1iX9UA9Ha1Z9nGTwZtMI4cunM8ZKng/j8dzd94DpAduimZF9lpLulZsVrRY2CtoWC55EW+OqjiazB+83srK4uyB6vPa3yrGiqWqwcglZ1mx2dJANNRq67WINl2TalDCuLtFR9QF9xG2acGrX0r/+JjTirNpqcAjoTc0eZgaaTbE8qIIQu2cfCL3TPtnDXyvHuvVt+Cxu8Ncvgektzluk9TvuU3cHLx4OwHYYX1ilHH4RXTGaRZz/p+BeIGxQ+4w50urN9I/H3DGEt8jTAlsVW699qEIT+unYsZZf2dEBb6g6f2OOH9Wh3MZc4E7luORi9K8crZpBlu5B6kCd4xsZ609+MoA+ojgFRbcxVR+VXH2ir1dcjm3O977H9a3b4fsTrU750447UcJrIDUl8ZFwJlIe7qCQ746qdOvCFGvDEzIGxZs4kDQZrBQEqTnqWDknstp+8/5mDU= 2020-04-02T23:39:11.195 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:39:11.244 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-02T23:39:11.250 INFO:teuthology.task.internal:Saving configuration 2020-04-02T23:39:11.272 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-02T23:39:11.282 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-02T23:39:11.298 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:34:11.239968', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi082.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNShlGgPjWIxWNX1F0En2l/IVIsPR6+9xFW5yMW19xvMRyb5QCCGSvG/YrjMEAe7f2hjXz9EdTe7L3kHjp9yH70=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919121'} 2020-04-02T23:39:11.314 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:34:11.239990', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi050.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLolgJ9I6ib6Ndd8bnrz9RRIrR8M+tx8jngzCosLn5wmvR4GwZdq6oPtMj6+049DcJMcygxLtxb/H83Ej3N5Zlo=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919121'} 2020-04-02T23:39:11.314 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-02T23:39:11.324 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-04-02T23:39:11.325 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-04-02T23:39:11.325 INFO:teuthology.run_tasks:Running task console_log... 2020-04-02T23:39:11.395 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:39:11.396 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-02T23:39:11.408 INFO:teuthology.task.internal:Opening connections... 2020-04-02T23:39:11.408 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:39:11.410 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:39:11.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:39:11.486 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:39:11.559 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-02T23:39:11.569 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:11.617 INFO:teuthology.orchestra.run.smithi050:> uname -m 2020-04-02T23:39:11.671 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2020-04-02T23:39:11.671 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:11.725 INFO:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2020-04-02T23:39:11.778 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Linux" 2020-04-02T23:39:11.778 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8 (Core)" 2020-04-02T23:39:11.778 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2020-04-02T23:39:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:39:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2020-04-02T23:39:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:39:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:39:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2020-04-02T23:39:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:39:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:39:11.780 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:39:11.780 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:11.780 INFO:teuthology.orchestra.run.smithi050.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:39:11.780 INFO:teuthology.orchestra.run.smithi050.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:39:11.780 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:39:11.780 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:39:11.780 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:11.781 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2020-04-02T23:39:11.803 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:11.817 INFO:teuthology.orchestra.run.smithi082:> uname -m 2020-04-02T23:39:11.872 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2020-04-02T23:39:11.872 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:11.924 INFO:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2020-04-02T23:39:11.981 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Linux" 2020-04-02T23:39:11.981 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8 (Core)" 2020-04-02T23:39:11.981 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2020-04-02T23:39:11.981 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:39:11.981 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2020-04-02T23:39:11.982 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:39:11.982 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:39:11.982 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2020-04-02T23:39:11.982 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:39:11.982 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:39:11.982 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:39:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:11.983 INFO:teuthology.orchestra.run.smithi082.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:39:11.983 INFO:teuthology.orchestra.run.smithi082.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:39:11.983 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:39:11.983 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:39:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:11.984 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2020-04-02T23:39:11.995 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-02T23:39:12.042 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-02T23:39:12.052 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-02T23:39:12.052 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:12.067 INFO:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:39:12.114 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:12.127 INFO:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:39:12.181 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-02T23:39:12.191 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-02T23:39:12.191 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:12.205 INFO:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:39:12.248 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:12.261 INFO:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:39:12.321 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-02T23:39:12.362 INFO:teuthology.run_tasks:Running task kernel... 2020-04-02T23:39:12.379 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2020-04-02T23:39:12.379 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-02T23:39:12.379 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:12.392 INFO:teuthology.orchestra.run.smithi082:> uname -r 2020-04-02T23:39:12.446 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:39:12.446 INFO:teuthology.task.kernel:Running kernel on smithi082: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:39:12.446 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:12.500 INFO:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2020-04-02T23:39:17.698 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - AppStream 17 MB/s | 6.6 MB 00:00 2020-04-02T23:39:18.869 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - Base 42 MB/s | 5.0 MB 00:00 2020-04-02T23:39:19.651 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - Extras 64 kB/s | 4.4 kB 00:00 2020-04-02T23:39:19.804 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for ceph-el8 owned by ktdreyer 435 kB/s | 47 kB 00:00 2020-04-02T23:39:20.211 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 17 MB/s | 6.2 MB 00:00 2020-04-02T23:39:21.468 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 6.6 MB/s | 30 kB 00:00 2020-04-02T23:39:22.625 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:39:22.626 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:39:22.787 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2020-04-02T23:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2020-04-02T23:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2020-04-02T23:39:22.933 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:22.948 INFO:teuthology.orchestra.run.smithi082:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:39:23.383 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:39:21 PM UTC. 2020-04-02T23:39:23.763 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2020-04-02T23:39:23.764 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:39:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2020-04-02T23:39:23.765 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:39:23.765 INFO:teuthology.orchestra.run.smithi082.stdout:Reinstalling: 2020-04-02T23:39:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:39:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:39:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:23.765 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2020-04-02T23:39:23.766 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:39:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:23.766 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 3.1 M 2020-04-02T23:39:23.767 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 0 2020-04-02T23:39:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:Operation aborted. 2020-04-02T23:39:23.874 INFO:teuthology.orchestra.run.smithi082.stdout:Is this ok [y/N]: 2020-04-02T23:39:23.875 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:23.889 INFO:teuthology.orchestra.run.smithi082:> sudo yum reinstall -y kernel || true 2020-04-02T23:39:24.320 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:39:21 PM UTC. 2020-04-02T23:39:24.678 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2020-04-02T23:39:24.679 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:39:24.679 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2020-04-02T23:39:24.680 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:39:24.680 INFO:teuthology.orchestra.run.smithi082.stdout:Reinstalling: 2020-04-02T23:39:24.680 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:39:24.680 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:39:24.680 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:24.680 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2020-04-02T23:39:24.680 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:39:24.681 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:24.681 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 3.1 M 2020-04-02T23:39:24.681 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 0 2020-04-02T23:39:24.681 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2020-04-02T23:39:24.762 INFO:teuthology.orchestra.run.smithi082.stdout:(1/2): kernel-4.18.0-147.el8.x86_64.rpm 19 MB/s | 1.5 MB 00:00 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi082.stdout:(2/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi082.stdout:Total 34 MB/s | 3.1 MB 00:00 2020-04-02T23:39:24.798 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2020-04-02T23:39:24.972 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2020-04-02T23:39:24.972 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2020-04-02T23:39:25.041 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2020-04-02T23:39:25.041 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2020-04-02T23:39:25.173 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2020-04-02T23:39:25.326 INFO:teuthology.orchestra.run.smithi082.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:39:25.485 INFO:teuthology.orchestra.run.smithi082.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:39:25.486 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:39:25.578 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:39:25.578 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:39:25.804 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:39:25.805 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:39:25.805 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:39:25.805 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:39:26.176 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:39:26.176 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:26.176 INFO:teuthology.orchestra.run.smithi082.stdout:Reinstalled: 2020-04-02T23:39:26.176 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:39:26.176 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:26.176 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2020-04-02T23:39:26.273 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:26.287 INFO:teuthology.orchestra.run.smithi082:> rpm -q kernel --last | head -n 1 2020-04-02T23:39:26.393 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:39:25 PM UTC 2020-04-02T23:39:26.394 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:39:26.395 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-04-02T23:39:26.395 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:26.412 INFO:teuthology.orchestra.run.smithi050:> uname -r 2020-04-02T23:39:26.469 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:39:26.469 INFO:teuthology.task.kernel:Running kernel on smithi050: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:39:26.470 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:26.525 INFO:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2020-04-02T23:39:29.155 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - AppStream 26 MB/s | 6.6 MB 00:00 2020-04-02T23:39:30.383 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Base 38 MB/s | 5.0 MB 00:00 2020-04-02T23:39:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Extras 69 kB/s | 4.4 kB 00:00 2020-04-02T23:39:31.353 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for ceph-el8 owned by ktdreyer 465 kB/s | 47 kB 00:00 2020-04-02T23:39:31.713 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 20 MB/s | 6.2 MB 00:00 2020-04-02T23:39:33.076 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 5.8 MB/s | 30 kB 00:00 2020-04-02T23:39:34.022 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:39:34.022 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:39:34.191 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2020-04-02T23:39:34.193 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2020-04-02T23:39:34.193 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2020-04-02T23:39:34.337 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:34.350 INFO:teuthology.orchestra.run.smithi050:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:39:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:01 ago on Thu 02 Apr 2020 11:39:33 PM UTC. 2020-04-02T23:39:35.171 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2020-04-02T23:39:35.172 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:39:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2020-04-02T23:39:35.172 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:39:35.172 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalling: 2020-04-02T23:39:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:39:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:39:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:35.173 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2020-04-02T23:39:35.173 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:39:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:35.174 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 3.1 M 2020-04-02T23:39:35.174 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 0 2020-04-02T23:39:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:Operation aborted. 2020-04-02T23:39:35.258 INFO:teuthology.orchestra.run.smithi050.stdout:Is this ok [y/N]: 2020-04-02T23:39:35.259 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:35.272 INFO:teuthology.orchestra.run.smithi050:> sudo yum reinstall -y kernel || true 2020-04-02T23:39:35.728 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:39:33 PM UTC. 2020-04-02T23:39:36.112 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2020-04-02T23:39:36.112 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:39:36.113 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2020-04-02T23:39:36.113 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:39:36.113 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalling: 2020-04-02T23:39:36.113 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:39:36.113 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:39:36.113 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:36.113 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2020-04-02T23:39:36.114 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:39:36.114 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:36.114 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 3.1 M 2020-04-02T23:39:36.114 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 0 2020-04-02T23:39:36.115 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2020-04-02T23:39:36.172 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 26 MB/s | 1.5 MB 00:00 2020-04-02T23:39:36.182 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 22 MB/s | 1.5 MB 00:00 2020-04-02T23:39:36.183 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:39:36.183 INFO:teuthology.orchestra.run.smithi050.stdout:Total 44 MB/s | 3.1 MB 00:00 2020-04-02T23:39:36.208 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2020-04-02T23:39:36.389 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2020-04-02T23:39:36.389 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2020-04-02T23:39:36.458 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2020-04-02T23:39:36.458 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2020-04-02T23:39:36.633 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2020-04-02T23:39:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:39:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:39:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:39:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:39:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:39:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:39:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:39:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:39:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:39:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:39:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:37.724 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalled: 2020-04-02T23:39:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:39:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:37.725 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2020-04-02T23:39:37.819 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:37.833 INFO:teuthology.orchestra.run.smithi050:> rpm -q kernel --last | head -n 1 2020-04-02T23:39:37.926 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:39:36 PM UTC 2020-04-02T23:39:37.927 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:39:37.927 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-04-02T23:39:37.927 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-04-02T23:39:37.928 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-04-02T23:39:37.928 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-04-02T23:39:37.928 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-04-02T23:39:37.928 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2020-04-02T23:39:37.928 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:37.944 INFO:teuthology.orchestra.run.smithi082:> rpm -q kernel --last | head -n 1 2020-04-02T23:39:38.030 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:39:25 PM UTC 2020-04-02T23:39:38.032 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:39:38.032 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:38.046 INFO:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2020-04-02T23:39:38.119 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2020-04-02T23:39:38.119 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2020-04-02T23:39:38.119 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.02 2020-04-02T23:39:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 78.el8 2020-04-02T23:39:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2020-04-02T23:39:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Mon 30 Mar 2020 07:18:38 PM UTC 2020-04-02T23:39:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:Group : System Environment/Base 2020-04-02T23:39:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 9192691 2020-04-02T23:39:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2020-04-02T23:39:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : kbuilder.bsys.centos.org 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Relocations : (not relocatable) 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : CentOS BuildSystem 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2020-04-02T23:39:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:39:38.122 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2020-04-02T23:39:38.123 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-04-02T23:39:38.123 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 4.18.0-147.el8.x86_64 2020-04-02T23:39:38.124 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:38.178 INFO:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-04-02T23:39:39.435 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2020-04-02T23:39:41.754 INFO:teuthology.orchestra.run.smithi082.stderr:done 2020-04-02T23:39:41.755 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:41.769 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:39:41.822 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.HjLIFcJLrO 2020-04-02T23:39:41.823 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:41.875 INFO:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HjLIFcJLrO 2020-04-02T23:39:41.948 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:42.001 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.HjLIFcJLrO 2020-04-02T23:39:42.136 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.HjLIFcJLrO is 4KB 2020-04-02T23:39:42.185 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:42.198 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.HjLIFcJLrO 2020-04-02T23:39:42.251 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:42.304 INFO:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2020-04-02T23:39:42.394 INFO:teuthology.orchestra.run.smithi082.stdout:ac76e1f739a34903a61708b8315bf038-0-rescue.conf 2020-04-02T23:39:42.395 INFO:teuthology.orchestra.run.smithi082.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.5.1.el8_1.x86_64.conf 2020-04-02T23:39:42.395 INFO:teuthology.orchestra.run.smithi082.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64.conf 2020-04-02T23:39:42.396 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:42.409 INFO:teuthology.orchestra.run.smithi082:> sudo grub2-set-default ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64 2020-04-02T23:39:42.570 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:39:42.583 INFO:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2020-04-02T23:39:42.625 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-04-02T23:39:42.625 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2020-04-02T23:39:42.626 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:42.642 INFO:teuthology.orchestra.run.smithi050:> rpm -q kernel --last | head -n 1 2020-04-02T23:39:42.731 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:39:36 PM UTC 2020-04-02T23:39:42.733 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:39:42.733 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:42.748 INFO:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2020-04-02T23:39:42.826 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2020-04-02T23:39:42.827 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2020-04-02T23:39:42.827 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.02 2020-04-02T23:39:42.827 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 78.el8 2020-04-02T23:39:42.827 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2020-04-02T23:39:42.827 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Mon 30 Mar 2020 07:18:38 PM UTC 2020-04-02T23:39:42.827 INFO:teuthology.orchestra.run.smithi050.stdout:Group : System Environment/Base 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 9192691 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : kbuilder.bsys.centos.org 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:Relocations : (not relocatable) 2020-04-02T23:39:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : CentOS BuildSystem 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2020-04-02T23:39:42.829 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2020-04-02T23:39:42.830 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2020-04-02T23:39:42.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:39:42.830 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2020-04-02T23:39:42.831 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-04-02T23:39:42.831 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 4.18.0-147.el8.x86_64 2020-04-02T23:39:42.831 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:42.885 INFO:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-04-02T23:39:44.040 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2020-04-02T23:39:45.600 INFO:teuthology.orchestra.run.smithi050.stderr:done 2020-04-02T23:39:45.602 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:45.616 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:39:45.671 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.JUPSXErqo0 2020-04-02T23:39:45.671 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:45.725 INFO:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JUPSXErqo0 2020-04-02T23:39:45.811 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:45.826 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.JUPSXErqo0 2020-04-02T23:39:45.970 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.JUPSXErqo0 is 4KB 2020-04-02T23:39:46.020 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:46.039 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.JUPSXErqo0 2020-04-02T23:39:46.088 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:46.140 INFO:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2020-04-02T23:39:46.229 INFO:teuthology.orchestra.run.smithi050.stdout:ac76e1f739a34903a61708b8315bf038-0-rescue.conf 2020-04-02T23:39:46.230 INFO:teuthology.orchestra.run.smithi050.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.5.1.el8_1.x86_64.conf 2020-04-02T23:39:46.230 INFO:teuthology.orchestra.run.smithi050.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64.conf 2020-04-02T23:39:46.231 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:46.244 INFO:teuthology.orchestra.run.smithi050:> sudo grub2-set-default ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64 2020-04-02T23:39:46.411 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:39:46.425 INFO:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2020-04-02T23:40:16.497 INFO:teuthology.misc:Re-opening connections... 2020-04-02T23:40:16.497 INFO:teuthology.misc:trying to connect to ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:40:16.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:40:16.498 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:16.499 DEBUG:teuthology.orchestra.remote:timed out 2020-04-02T23:41:16.500 INFO:teuthology.misc:trying to connect to ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:41:16.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:41:16.501 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:19.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2020-04-02T23:41:19.573 DEBUG:teuthology.misc:waited 63.0763869286 2020-04-02T23:41:20.574 INFO:teuthology.misc:trying to connect to ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:41:20.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:41:20.575 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:21.947 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:22.310 DEBUG:teuthology.misc:waited 65.8136339188 2020-04-02T23:41:23.311 INFO:teuthology.misc:trying to connect to ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:41:23.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:41:23.312 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:26.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2020-04-02T23:41:26.389 DEBUG:teuthology.misc:waited 69.8920710087 2020-04-02T23:41:27.390 INFO:teuthology.misc:trying to connect to ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:41:27.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:41:27.391 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:29.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2020-04-02T23:41:29.461 DEBUG:teuthology.misc:waited 72.9641089439 2020-04-02T23:41:30.462 INFO:teuthology.misc:trying to connect to ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:41:30.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:41:30.463 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:32.533 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2020-04-02T23:41:32.533 DEBUG:teuthology.misc:waited 76.0361289978 2020-04-02T23:41:33.534 INFO:teuthology.misc:trying to connect to ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:41:33.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:41:33.535 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:35.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2020-04-02T23:41:35.605 DEBUG:teuthology.misc:waited 79.1080949306 2020-04-02T23:41:36.606 INFO:teuthology.misc:trying to connect to ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:41:36.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:41:36.607 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:41:37.018 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:37.366 DEBUG:teuthology.misc:waited 80.8693909645 2020-04-02T23:41:38.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-04-02T23:41:38.367 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.el8.x86_64"... 2020-04-02T23:41:38.368 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:38.383 INFO:teuthology.orchestra.run.smithi082:> uname -r 2020-04-02T23:41:38.438 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-147.el8.x86_64 2020-04-02T23:41:38.438 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-04-02T23:41:38.438 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-04-02T23:41:38.438 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-04-02T23:41:38.439 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-147.el8.x86_64"... 2020-04-02T23:41:38.439 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:38.459 INFO:teuthology.orchestra.run.smithi050:> uname -r 2020-04-02T23:41:38.516 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-147.el8.x86_64 2020-04-02T23:41:38.517 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-04-02T23:41:38.517 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-04-02T23:41:39.517 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-02T23:41:39.518 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:39.532 INFO:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:41:39.685 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2020-04-02T23:41:39.697 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-02T23:41:39.698 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:39.714 INFO:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:41:39.953 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2020-04-02T23:41:39.969 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-02T23:41:39.984 INFO:teuthology.task.internal:Creating test directory... 2020-04-02T23:41:39.984 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.000 INFO:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:41:40.043 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:40.057 INFO:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:41:40.111 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-02T23:41:40.118 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-02T23:41:40.127 INFO:teuthology.task.internal:Creating archive directory... 2020-04-02T23:41:40.127 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.143 INFO:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:41:40.185 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:40.198 INFO:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:41:40.256 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-02T23:41:40.264 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-02T23:41:40.264 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.279 INFO:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:41:40.322 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:40.335 INFO:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:41:40.364 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:41:40.382 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:41:40.419 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:41:40.433 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:41:40.435 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-02T23:41:40.450 INFO:teuthology.task.internal:Configuring sudo... 2020-04-02T23:41:40.450 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.467 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:41:40.509 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:40.522 INFO:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:41:40.590 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-02T23:41:40.602 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-02T23:41:40.602 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.616 INFO:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:41:40.658 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:40.672 INFO:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:41:40.725 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.739 INFO:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:41:40.811 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.850 INFO:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:41:40.932 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:40.985 INFO:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:41:41.058 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:41.096 INFO:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:41:41.166 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:41.220 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:41:41.306 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:41.319 INFO:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:41:41.392 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:41.427 INFO:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:41:41.493 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:41.543 INFO:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:41:41.619 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:41.647 INFO:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:41:41.713 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:41.764 INFO:teuthology.orchestra.run.smithi082:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:41:41.846 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:41.864 INFO:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2020-04-02T23:41:41.907 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:41.921 INFO:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2020-04-02T23:41:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:41:42.032 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:41:42.233 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-02T23:41:42.245 INFO:teuthology.task.internal:Starting timer... 2020-04-02T23:41:42.245 INFO:teuthology.run_tasks:Running task pcp... 2020-04-02T23:41:42.280 INFO:teuthology.run_tasks:Running task selinux... 2020-04-02T23:41:42.290 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-02T23:41:42.290 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:42.308 INFO:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2020-04-02T23:41:42.427 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: [ OK ] 2020-04-02T23:41:42.429 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:42.445 INFO:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2020-04-02T23:41:42.566 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: [ OK ] 2020-04-02T23:41:42.568 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-02T23:41:42.568 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:42.582 INFO:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2020-04-02T23:41:42.645 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2020-04-02T23:41:42.646 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:42.659 INFO:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2020-04-02T23:41:42.727 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2020-04-02T23:41:42.728 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi050.front.sepia.ceph.com': u'permissive'} 2020-04-02T23:41:42.729 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:42.742 INFO:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:41:42.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:41:42.813 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:42.827 INFO:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:41:42.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:41:42.895 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-02T23:41:42.895 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:41:42.909 INFO:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:41:42.980 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:41:42.993 INFO:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:41:43.062 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-02T23:41:43.074 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-04-02T23:41:43.084 INFO:teuthology.repo_utils:Fetching master from origin 2020-04-02T23:41:43.140 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-02T23:41:43.160 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-02T23:41:43.163 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-02T23:41:43.533 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-02T23:41:44.705 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-02T23:41:47.693 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-02T23:41:47.715 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:47 +0000 (0:00:00.061) 0:00:00.061 ******** 2020-04-02T23:41:47.729 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:47 +0000 (0:00:00.013) 0:00:00.075 ******** 2020-04-02T23:41:50.334 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-02T23:41:50.335 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] 2020-04-02T23:41:50.415 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:50 +0000 (0:00:02.686) 0:00:02.762 ******** 2020-04-02T23:41:50.425 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] 2020-04-02T23:41:50.520 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:50 +0000 (0:00:00.101) 0:00:02.863 ******** 2020-04-02T23:41:50.769 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:41:50.819 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:50 +0000 (0:00:00.302) 0:00:03.165 ******** 2020-04-02T23:41:50.820 INFO:teuthology.task.ansible.out: 2020-04-02T23:41:50.827 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:41:50.828 INFO:teuthology.task.ansible.out: 2020-04-02T23:41:50.867 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:50 +0000 (0:00:00.047) 0:00:03.213 ******** 2020-04-02T23:41:51.427 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi082.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:41:51.428 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:41:51.482 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:51 +0000 (0:00:00.615) 0:00:03.828 ******** 2020-04-02T23:41:51.526 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:51 +0000 (0:00:00.043) 0:00:03.872 ******** 2020-04-02T23:41:51.532 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-02T23:41:51.533 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:51.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:51 +0000 (0:00:00.044) 0:00:03.917 ******** 2020-04-02T23:41:51.577 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:51.614 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:51 +0000 (0:00:00.043) 0:00:03.961 ******** 2020-04-02T23:41:51.899 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi082.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:41:51.937 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:51 +0000 (0:00:00.322) 0:00:04.283 ******** 2020-04-02T23:41:51.943 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:41:51.991 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:51 +0000 (0:00:00.054) 0:00:04.337 ******** 2020-04-02T23:41:51.992 INFO:teuthology.task.ansible.out: 2020-04-02T23:41:52.807 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-04-02T23:41:52.809 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585870911.95-160484094526264/source", "state": "file", "uid": 0} 2020-04-02T23:41:52.809 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585870912.01-45180208990327/source", "state": "file", "uid": 0} 2020-04-02T23:41:52.844 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:52 +0000 (0:00:00.853) 0:00:05.191 ******** 2020-04-02T23:41:52.875 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:52 +0000 (0:00:00.030) 0:00:05.221 ******** 2020-04-02T23:41:53.276 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-02T23:41:53.276 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-02T23:41:53.278 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:41:53.313 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-02T23:41:53.314 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:41:53.431 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-02T23:41:53.437 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-02T23:41:53.618 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:53 +0000 (0:00:00.743) 0:00:05.965 ******** 2020-04-02T23:41:53.651 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:53 +0000 (0:00:00.032) 0:00:05.997 ******** 2020-04-02T23:41:54.302 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi050.front.sepia.ceph.com] 2020-04-02T23:41:54.312 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] 2020-04-02T23:41:54.419 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-04-02T23:41:54.421 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:54 +0000 (0:00:00.768) 0:00:06.766 ******** 2020-04-02T23:41:54.455 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:54 +0000 (0:00:00.035) 0:00:06.802 ******** 2020-04-02T23:41:55.089 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-02T23:41:55.091 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.227611", "end": "2020-04-02 23:41:55.030651", "rc": 0, "start": "2020-04-02 23:41:54.803040", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:41:55.093 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.240591", "end": "2020-04-02 23:41:55.051468", "rc": 0, "start": "2020-04-02 23:41:54.810877", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:41:55.134 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.677) 0:00:07.480 ******** 2020-04-02T23:41:55.170 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.035) 0:00:07.516 ******** 2020-04-02T23:41:55.353 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-04-02T23:41:55.356 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008563", "end": "2020-04-02 23:41:55.332455", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:41:55.323892", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:41:55.394 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.223) 0:00:07.740 ******** 2020-04-02T23:41:55.429 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.031780", "end": "2020-04-02 23:41:55.388035", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:41:55.356255", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:41:55.466 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.072) 0:00:07.812 ******** 2020-04-02T23:41:55.471 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-02T23:41:55.472 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:41:55.511 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.044) 0:00:07.857 ******** 2020-04-02T23:41:55.517 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:41:55.561 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.046) 0:00:07.903 ******** 2020-04-02T23:41:55.563 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-02T23:41:55.564 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.606 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.048) 0:00:07.952 ******** 2020-04-02T23:41:55.612 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.652 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.046) 0:00:07.998 ******** 2020-04-02T23:41:55.659 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-02T23:41:55.661 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.703 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.051) 0:00:08.049 ******** 2020-04-02T23:41:55.710 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.748 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.044) 0:00:08.094 ******** 2020-04-02T23:41:55.754 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.793 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.044) 0:00:08.139 ******** 2020-04-02T23:41:55.798 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.842 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.049) 0:00:08.188 ******** 2020-04-02T23:41:55.850 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.886 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.044) 0:00:08.232 ******** 2020-04-02T23:41:55.897 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.931 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.044) 0:00:08.277 ******** 2020-04-02T23:41:55.936 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-02T23:41:55.937 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:55.977 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:55 +0000 (0:00:00.046) 0:00:08.324 ******** 2020-04-02T23:41:55.983 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.023 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:56 +0000 (0:00:00.045) 0:00:08.369 ******** 2020-04-02T23:41:56.041 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-02T23:41:56.042 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.046 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.055 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5 2020-04-02T23:41:56.056 INFO:teuthology.task.ansible.out:YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.067 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.067 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.069 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.079 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.079 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.081 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.092 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.092 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.094 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4 2020-04-02T23:41:56.095 INFO:teuthology.task.ansible.out:d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.105 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.106 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.107 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W 2020-04-02T23:41:56.108 INFO:teuthology.task.ansible.out:4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.118 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.118 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.120 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.121 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.131 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.132 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.143 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.143 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.145 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.157 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.157 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.159 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.170 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.170 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.172 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.193 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.194 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.196 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.196 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2020-04-02T23:41:56.197 INFO:teuthology.task.ansible.out:": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.208 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.209 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.223 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.225 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.227 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.228 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.230 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.231 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.242 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.243 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.255 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.256 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.257 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.258 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.269 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.270 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.271 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.272 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.274 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.275 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.285 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.287 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.288 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.306 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.307 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.309 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.310 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.326 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.326 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.328 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.329 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.330 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.347 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.348 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.357 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.358 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.358 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.360 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.361 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.362 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.363 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.374 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.375 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.376 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.377 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.379 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.380 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.391 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.392 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.403 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.404 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.405 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.405 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.407 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.419 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.420 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.421 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.422 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.434 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.435 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.436 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.449 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.452 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.454 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.455 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.457 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.458 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.470 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.470 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.472 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.473 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.484 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.485 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.486 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.498 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.499 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.501 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.502 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.503 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.504 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.505 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.512 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.517 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.517 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.519 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.520 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.522 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.533 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.534 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.536 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.547 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.553 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.569 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.570 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.572 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.584 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.586 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.586 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.588 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.590 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.591 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.592 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.596 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.599 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.600 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce3 2020-04-02T23:41:56.601 INFO:teuthology.task.ansible.out:3e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.612 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.613 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.614 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.614 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.616 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.616 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.627 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.628 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.629 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.640 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.641 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.642 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.644 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.655 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.655 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.656 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.667 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.668 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.672 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.680 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.681 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.682 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.693 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.694 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.717 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.718 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.719 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.722 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2020-04-02T23:41:56.726 INFO:teuthology.task.ansible.out:rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc 2020-04-02T23:41:56.728 INFO:teuthology.task.ansible.out:588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.736 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.737 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.738 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.740 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.751 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.751 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.762 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.783 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.784 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.785 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.787 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.788 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:56.845 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:56 +0000 (0:00:00.818) 0:00:09.188 ******** 2020-04-02T23:41:56.878 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:56 +0000 (0:00:00.036) 0:00:09.225 ******** 2020-04-02T23:41:56.894 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-02T23:41:56.932 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:56 +0000 (0:00:00.053) 0:00:09.278 ******** 2020-04-02T23:41:56.975 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:56 +0000 (0:00:00.043) 0:00:09.322 ******** 2020-04-02T23:41:56.985 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.036 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.060) 0:00:09.382 ******** 2020-04-02T23:41:57.043 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.089 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.053) 0:00:09.436 ******** 2020-04-02T23:41:57.095 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-02T23:41:57.097 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.136 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.046) 0:00:09.482 ******** 2020-04-02T23:41:57.143 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.184 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.048) 0:00:09.531 ******** 2020-04-02T23:41:57.190 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-02T23:41:57.191 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.229 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.044) 0:00:09.575 ******** 2020-04-02T23:41:57.237 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.275 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.046) 0:00:09.622 ******** 2020-04-02T23:41:57.281 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-02T23:41:57.281 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.049) 0:00:09.671 ******** 2020-04-02T23:41:57.330 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.369 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.044) 0:00:09.715 ******** 2020-04-02T23:41:57.373 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-02T23:41:57.373 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.410 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.040) 0:00:09.756 ******** 2020-04-02T23:41:57.415 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.453 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.043) 0:00:09.799 ******** 2020-04-02T23:41:57.459 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-02T23:41:57.459 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.461 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.462 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.473 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.473 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.485 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.486 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.487 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.488 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.498 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.499 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.500 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.511 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.511 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.513 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.523 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.523 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.525 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.526 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.537 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.537 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.539 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.540 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.540 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.551 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.553 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.577 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.577 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.579 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.579 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.590 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.591 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.596 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.597 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.598 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.598 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.607 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.608 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.609 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.610 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.614 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.625 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.626 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.628 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.638 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.639 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.640 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.651 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.653 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.654 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.656 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.667 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.669 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.682 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.684 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.694 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.702 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.703 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.705 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.706 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.744 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.290) 0:00:10.090 ******** 2020-04-02T23:41:57.751 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.752 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.754 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.755 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:41:57.796 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:57 +0000 (0:00:00.052) 0:00:10.142 ******** 2020-04-02T23:41:58.518 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-02T23:41:58.518 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:41:58.561 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.764) 0:00:10.907 ******** 2020-04-02T23:41:58.567 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:41:58.621 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.060) 0:00:10.967 ******** 2020-04-02T23:41:58.626 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-02T23:41:58.628 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => { "msg": "Host smithi082.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:41:58.665 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.044) 0:00:11.012 ******** 2020-04-02T23:41:58.671 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => { "msg": "Host smithi050.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:41:58.717 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.047) 0:00:11.059 ******** 2020-04-02T23:41:58.719 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-02T23:41:58.719 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:41:58.762 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.048) 0:00:11.108 ******** 2020-04-02T23:41:58.766 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:41:58.804 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.042) 0:00:11.151 ******** 2020-04-02T23:41:58.812 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-02T23:41:58.814 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:58.850 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.045) 0:00:11.197 ******** 2020-04-02T23:41:58.856 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:58.895 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:58 +0000 (0:00:00.043) 0:00:11.240 ******** 2020-04-02T23:41:59.154 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.089309", "end": "2020-04-02 23:41:59.122183", "rc": 0, "start": "2020-04-02 23:41:59.032874", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:41:59.195 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.301) 0:00:11.542 ******** 2020-04-02T23:41:59.201 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.090051", "end": "2020-04-02 23:41:59.172867", "rc": 0, "start": "2020-04-02 23:41:59.082816", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:41:59.239 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.043) 0:00:11.585 ******** 2020-04-02T23:41:59.244 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-02T23:41:59.246 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.283 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.044) 0:00:11.630 ******** 2020-04-02T23:41:59.289 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.333 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.049) 0:00:11.679 ******** 2020-04-02T23:41:59.338 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-02T23:41:59.339 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.377 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.044) 0:00:11.724 ******** 2020-04-02T23:41:59.384 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.423 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.045) 0:00:11.770 ******** 2020-04-02T23:41:59.429 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-02T23:41:59.430 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.467 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.043) 0:00:11.813 ******** 2020-04-02T23:41:59.472 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.512 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.044) 0:00:11.858 ******** 2020-04-02T23:41:59.518 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-02T23:41:59.518 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.059) 0:00:11.918 ******** 2020-04-02T23:41:59.578 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.617 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.045) 0:00:11.963 ******** 2020-04-02T23:41:59.625 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-02T23:41:59.625 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.665 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.047) 0:00:12.011 ******** 2020-04-02T23:41:59.671 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.712 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.047) 0:00:12.059 ******** 2020-04-02T23:41:59.720 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-02T23:41:59.720 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.762 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.049) 0:00:12.108 ******** 2020-04-02T23:41:59.768 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.807 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.045) 0:00:12.153 ******** 2020-04-02T23:41:59.811 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-02T23:41:59.812 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:41:59.814 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:41:59.857 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.050) 0:00:12.204 ******** 2020-04-02T23:41:59.863 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:41:59.863 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:41:59.903 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.045) 0:00:12.249 ******** 2020-04-02T23:41:59.908 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-02T23:41:59.910 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:41:59.952 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.048) 0:00:12.298 ******** 2020-04-02T23:41:59.957 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.000 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:41:59 +0000 (0:00:00.048) 0:00:12.346 ******** 2020-04-02T23:42:00.006 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-02T23:42:00.007 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.048 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.044) 0:00:12.391 ******** 2020-04-02T23:42:00.050 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.088 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.043) 0:00:12.434 ******** 2020-04-02T23:42:00.097 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi082.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:00.137 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.048) 0:00:12.483 ******** 2020-04-02T23:42:00.145 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:00.182 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.045) 0:00:12.529 ******** 2020-04-02T23:42:00.188 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-02T23:42:00.190 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.240 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.057) 0:00:12.586 ******** 2020-04-02T23:42:00.246 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.286 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.046) 0:00:12.633 ******** 2020-04-02T23:42:00.292 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-02T23:42:00.294 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:00.333 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.046) 0:00:12.679 ******** 2020-04-02T23:42:00.338 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:00.383 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.050) 0:00:12.729 ******** 2020-04-02T23:42:00.391 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-02T23:42:00.393 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.432 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.048) 0:00:12.778 ******** 2020-04-02T23:42:00.439 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.480 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.047) 0:00:12.826 ******** 2020-04-02T23:42:00.486 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-02T23:42:00.487 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.529 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.048) 0:00:12.875 ******** 2020-04-02T23:42:00.534 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.578 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.049) 0:00:12.924 ******** 2020-04-02T23:42:00.584 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-02T23:42:00.584 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.622 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.044) 0:00:12.969 ******** 2020-04-02T23:42:00.630 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.666 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.044) 0:00:13.013 ******** 2020-04-02T23:42:00.668 INFO:teuthology.task.ansible.out: 2020-04-02T23:42:00.673 INFO:teuthology.task.ansible.out: 2020-04-02T23:42:00.675 INFO:teuthology.task.ansible.out:TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.047) 0:00:13.060 ******** 2020-04-02T23:42:00.719 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.762 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.047) 0:00:13.108 ******** 2020-04-02T23:42:00.767 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-02T23:42:00.768 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:00.806 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.044) 0:00:13.153 ******** 2020-04-02T23:42:00.812 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:00.856 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.043) 0:00:13.197 ******** 2020-04-02T23:42:00.861 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.896 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.046) 0:00:13.243 ******** 2020-04-02T23:42:00.905 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.944 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.043) 0:00:13.286 ******** 2020-04-02T23:42:00.946 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-02T23:42:00.946 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:00.986 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:00 +0000 (0:00:00.046) 0:00:13.333 ******** 2020-04-02T23:42:00.992 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.030 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.043) 0:00:13.377 ******** 2020-04-02T23:42:01.037 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-02T23:42:01.038 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.076 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.045) 0:00:13.422 ******** 2020-04-02T23:42:01.083 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.121 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.044) 0:00:13.467 ******** 2020-04-02T23:42:01.127 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-02T23:42:01.129 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.169 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.047) 0:00:13.514 ******** 2020-04-02T23:42:01.173 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.217 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.043) 0:00:13.558 ******** TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.258 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.045) 0:00:13.603 ******** 2020-04-02T23:42:01.262 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.301 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.044) 0:00:13.647 ******** 2020-04-02T23:42:01.314 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-02T23:42:01.315 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.351 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.050) 0:00:13.698 ******** 2020-04-02T23:42:01.357 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.396 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.043) 0:00:13.742 ******** 2020-04-02T23:42:01.401 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-02T23:42:01.402 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:01.440 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.044) 0:00:13.786 ******** 2020-04-02T23:42:01.445 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:42:01.483 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.043) 0:00:13.829 ******** 2020-04-02T23:42:01.489 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-02T23:42:01.527 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.043) 0:00:13.873 ******** 2020-04-02T23:42:01.573 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.046) 0:00:13.919 ******** 2020-04-02T23:42:01.579 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-02T23:42:01.580 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.617 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.044) 0:00:13.963 ******** 2020-04-02T23:42:01.622 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:01.660 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.042) 0:00:14.006 ******** 2020-04-02T23:42:01.854 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-02T23:42:01.856 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:42:01.891 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.231) 0:00:14.238 ******** 2020-04-02T23:42:01.908 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:42:01.946 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:01 +0000 (0:00:00.054) 0:00:14.292 ******** 2020-04-02T23:42:02.395 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-02T23:42:02.397 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:42:02.495 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:42:02.866 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:42:02.922 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:02 +0000 (0:00:00.975) 0:00:15.268 ******** 2020-04-02T23:42:03.002 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:42:03.049 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:03 +0000 (0:00:00.126) 0:00:15.395 ******** 2020-04-02T23:42:03.422 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-02T23:42:03.424 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:42:03.558 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:42:03.906 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:42:03.965 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:03 +0000 (0:00:00.916) 0:00:16.311 ******** 2020-04-02T23:42:04.018 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:42:04.020 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.059 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.093) 0:00:16.405 ******** 2020-04-02T23:42:04.075 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-02T23:42:04.076 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:42:04.119 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.060) 0:00:16.466 ******** 2020-04-02T23:42:04.126 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:42:04.128 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.169 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.047) 0:00:16.513 ******** 2020-04-02T23:42:04.172 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:42:04.173 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.214 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.047) 0:00:16.560 ******** 2020-04-02T23:42:04.219 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-02T23:42:04.220 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.259 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.044) 0:00:16.605 ******** 2020-04-02T23:42:04.264 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:42:04.264 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.306 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.047) 0:00:16.653 ******** 2020-04-02T23:42:04.312 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-02T23:42:04.314 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.356 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.049) 0:00:16.702 ******** 2020-04-02T23:42:04.361 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-02T23:42:04.363 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.400 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.044) 0:00:16.746 ******** 2020-04-02T23:42:04.406 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.446 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.045) 0:00:16.792 ******** 2020-04-02T23:42:04.451 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-02T23:42:04.451 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.489 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.043) 0:00:16.836 ******** 2020-04-02T23:42:04.495 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-02T23:42:04.496 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.541 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.051) 0:00:16.887 ******** 2020-04-02T23:42:04.548 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:42:04.549 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.586 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.045) 0:00:16.933 ******** 2020-04-02T23:42:04.592 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:42:04.593 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.634 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.047) 0:00:16.981 ******** 2020-04-02T23:42:04.639 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-02T23:42:04.641 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.680 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.045) 0:00:17.026 ******** 2020-04-02T23:42:04.685 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-02T23:42:04.686 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.731 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.051) 0:00:17.077 ******** 2020-04-02T23:42:04.739 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:42:04.740 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.797 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.064) 0:00:17.142 ******** 2020-04-02T23:42:04.811 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.849 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.052) 0:00:17.195 ******** 2020-04-02T23:42:04.854 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-02T23:42:04.856 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:04.898 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:04 +0000 (0:00:00.048) 0:00:17.244 ******** 2020-04-02T23:42:05.066 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-02T23:42:05.073 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:05.244 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:05 +0000 (0:00:00.346) 0:00:17.591 ******** 2020-04-02T23:42:05.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-02T23:42:05.524 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.464675", "end": "2020-04-02 23:42:05.500321", "rc": 0, "start": "2020-04-02 23:42:05.035646", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.066804", "end": "2020-04-02 23:42:05.500339", "rc": 0, "start": "2020-04-02 23:42:05.433535", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:42:05.589 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:05 +0000 (0:00:00.345) 0:00:17.936 ******** 2020-04-02T23:42:05.630 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:05 +0000 (0:00:00.037) 0:00:17.973 ******** 2020-04-02T23:42:08.698 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:42:08.743 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:08 +0000 (0:00:03.116) 0:00:21.089 ******** 2020-04-02T23:42:08.752 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:42:08.796 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:08 +0000 (0:00:00.053) 0:00:21.142 ******** 2020-04-02T23:42:08.801 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-02T23:42:08.802 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:08.842 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:08 +0000 (0:00:00.045) 0:00:21.188 ******** 2020-04-02T23:42:08.847 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:08.889 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:08 +0000 (0:00:00.047) 0:00:21.235 ******** 2020-04-02T23:42:08.895 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-02T23:42:08.895 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:08.935 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:08 +0000 (0:00:00.046) 0:00:21.282 ******** 2020-04-02T23:42:08.942 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:08.983 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:08 +0000 (0:00:00.047) 0:00:21.330 ******** 2020-04-02T23:42:08.990 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:09.034 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:09 +0000 (0:00:00.046) 0:00:21.376 ******** 2020-04-02T23:42:09.036 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:09.075 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:09 +0000 (0:00:00.044) 0:00:21.421 ******** 2020-04-02T23:42:09.082 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-02T23:42:09.084 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:09.121 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:09 +0000 (0:00:00.045) 0:00:21.467 ******** 2020-04-02T23:42:09.127 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:09.166 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:09 +0000 (0:00:00.045) 0:00:21.512 ******** 2020-04-02T23:42:09.618 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-02T23:42:09.619 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:42:09.658 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:09 +0000 (0:00:00.491) 0:00:22.003 ******** 2020-04-02T23:42:09.664 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:42:09.703 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:09 +0000 (0:00:00.045) 0:00:22.049 ******** 2020-04-02T23:42:10.603 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:42:10.665 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:10 +0000 (0:00:00.958) 0:00:23.008 ******** 2020-04-02T23:42:10.669 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:42:10.723 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:10 +0000 (0:00:00.061) 0:00:23.069 ******** 2020-04-02T23:42:11.156 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-02T23:42:11.157 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:42:11.261 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:42:11.263 INFO:teuthology.task.ansible.out: 2020-04-02T23:42:11.618 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:42:11.787 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:42:12.064 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:42:12.103 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:12 +0000 (0:00:01.380) 0:00:24.450 ******** 2020-04-02T23:42:12.262 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:42:12.303 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:12 +0000 (0:00:00.199) 0:00:24.649 ******** 2020-04-02T23:42:12.321 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-02T23:42:12.322 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:42:12.360 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:12 +0000 (0:00:00.057) 0:00:24.706 ******** 2020-04-02T23:42:12.516 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:42:12.559 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:12 +0000 (0:00:00.198) 0:00:24.905 ******** 2020-04-02T23:42:12.839 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:42:12.839 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:42:13.072 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:42:13.278 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:42:13.549 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:42:13.736 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:42:13.785 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:13 +0000 (0:00:01.225) 0:00:26.131 ******** 2020-04-02T23:42:13.816 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-02T23:42:13.818 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:13.859 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:13 +0000 (0:00:00.072) 0:00:26.203 ******** 2020-04-02T23:42:13.893 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-02T23:42:13.895 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:42:13.931 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:13 +0000 (0:00:00.074) 0:00:26.277 ******** 2020-04-02T23:42:14.033 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:42:14.035 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:42:14.085 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:14 +0000 (0:00:00.153) 0:00:26.431 ******** 2020-04-02T23:42:14.112 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-02T23:42:14.114 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.149 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:14 +0000 (0:00:00.063) 0:00:26.495 ******** 2020-04-02T23:42:14.155 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-02T23:42:14.156 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:42:14.194 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:14 +0000 (0:00:00.044) 0:00:26.540 ******** 2020-04-02T23:42:14.200 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-02T23:42:14.200 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:42:14.239 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:14 +0000 (0:00:00.045) 0:00:26.585 ******** 2020-04-02T23:42:14.246 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-02T23:42:14.247 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.258 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.271 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.302 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.348 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:14 +0000 (0:00:00.108) 0:00:26.694 ******** 2020-04-02T23:42:14.471 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:42:14.513 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:14 +0000 (0:00:00.165) 0:00:26.859 ******** 2020-04-02T23:42:14.551 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-02T23:42:14.557 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.563 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.566 INFO:teuthology.task.ansible.out: 2020-04-02T23:42:14.577 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.589 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:42:14.629 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:14 +0000 (0:00:00.115) 0:00:26.975 ******** 2020-04-02T23:42:15.264 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:42:15.300 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:15 +0000 (0:00:00.671) 0:00:27.646 ******** 2020-04-02T23:42:15.338 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:15.375 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:15 +0000 (0:00:00.075) 0:00:27.722 ******** 2020-04-02T23:42:15.377 INFO:teuthology.task.ansible.out: 2020-04-02T23:42:15.598 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-02T23:42:15.599 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:42:15.647 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:15 +0000 (0:00:00.271) 0:00:27.993 ******** 2020-04-02T23:42:15.681 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-02T23:42:15.682 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:15.723 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:15 +0000 (0:00:00.074) 0:00:28.067 ******** 2020-04-02T23:42:15.871 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-02T23:42:15.872 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:42:15.926 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:15 +0000 (0:00:00.205) 0:00:28.272 ******** 2020-04-02T23:42:16.229 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:42:16.285 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:16 +0000 (0:00:00.358) 0:00:28.631 ******** 2020-04-02T23:42:16.412 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:42:16.414 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:42:16.460 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:16 +0000 (0:00:00.175) 0:00:28.806 ******** 2020-04-02T23:42:16.488 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:42:16.489 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:16.529 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:16 +0000 (0:00:00.069) 0:00:28.875 ******** 2020-04-02T23:42:16.738 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-02T23:42:16.739 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:42:16.776 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:16 +0000 (0:00:00.247) 0:00:29.123 ******** 2020-04-02T23:42:16.818 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:42:16.822 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:42:16.865 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:16 +0000 (0:00:00.088) 0:00:29.211 ******** 2020-04-02T23:42:16.903 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:42:16.905 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:16.947 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:16 +0000 (0:00:00.081) 0:00:29.293 ******** 2020-04-02T23:42:17.040 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-02T23:42:17.041 INFO:teuthology.task.ansible.out:fatal: [smithi082.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:42:17.112 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:17 +0000 (0:00:00.165) 0:00:29.458 ******** 2020-04-02T23:42:17.150 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:42:17.152 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:17.200 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:17 +0000 (0:00:00.086) 0:00:29.544 ******** 2020-04-02T23:42:17.204 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-02T23:42:17.206 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:42:17.247 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:17 +0000 (0:00:00.048) 0:00:29.593 ******** 2020-04-02T23:42:17.538 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-02T23:42:17.540 INFO:teuthology.task.ansible.out:fatal: [smithi050.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:42:17.581 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:17 +0000 (0:00:00.334) 0:00:29.927 ******** 2020-04-02T23:42:17.618 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:42:17.619 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:17.657 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:17 +0000 (0:00:00.075) 0:00:30.003 ******** 2020-04-02T23:42:17.699 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-02T23:42:17.701 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:42:17.739 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:17 +0000 (0:00:00.081) 0:00:30.085 ******** 2020-04-02T23:42:18.176 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:42:18.211 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:18 +0000 (0:00:00.471) 0:00:30.557 ******** 2020-04-02T23:42:18.544 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-02T23:42:18.547 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:41:30 UTC", "ActiveEnterTimestampMonotonic": "12249745", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount nss-lookup.target systemd-tmpfiles-setup.service systemd-journald.socket network.target sysinit.target var-run.mount system.slice local-fs.target basic.target tmp.mount time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:41:30 UTC", "AssertTimestampMonotonic": "12248919", "Before": "shutdown.target xdm.service plymouth-quit.service multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:41:30 UTC", "ConditionTimestampMonotonic": "12248919", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:42:18.549 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2396", "ExecMainStartTimestamp": "Thu 2020-04-02 23:41:30 UTC", "ExecMainStartTimestampMonotonic": "12249713", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:41:30 UTC] ; stop_time=[n/a] ; pid=2396 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:41:30 UTC", "InactiveExitTimestampMonotonic": "12249745", "InvocationID": "18e2edb635d4485aa7f0eb4fea4281ce", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:42:18.551 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2396", "MemoryAccounting": "yes", "MemoryCurrent": "1691648", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:42:18.556 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:41:30 UTC", "StateChangeTimestampMonotonic": "12249745", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:41:30 UTC", "WatchdogTimestampMonotonic": "12249745", "WatchdogUSec": "0"}} 2020-04-02T23:42:18.589 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:18 +0000 (0:00:00.378) 0:00:30.936 ******** 2020-04-02T23:42:18.600 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:41:17 UTC", "ActiveEnterTimestampMonotonic": "11524675", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount network.target nss-lookup.target systemd-tmpfiles-setup.service time-sync.target -.mount local-fs.target system.slice systemd-journald.socket tmp.mount basic.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:41:17 UTC", "AssertTimestampMonotonic": "11523773", "Before": "multi-user.target plymouth-quit.service shutdown.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:41:17 UTC", "ConditionTimestampMonotonic": "11523773", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:42:18.602 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1544", "ExecMainStartTimestamp": "Thu 2020-04-02 23:41:17 UTC", "ExecMainStartTimestampMonotonic": "11524640", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:41:17 UTC] ; stop_time=[n/a] ; pid=1544 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:41:17 UTC", "InactiveExitTimestampMonotonic": "11524675", "InvocationID": "fa11608debf54c98846e57a280dc7d5e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:42:18.603 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127461", "LimitNPROCSoft": "127461", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127461", "LimitSIGPENDINGSoft": "127461", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1544", "MemoryAccounting": "yes", "MemoryCurrent": "1716224", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:42:18.605 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:41:17 UTC", "StateChangeTimestampMonotonic": "11524675", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:41:17 UTC", "WatchdogTimestampMonotonic": "11524674", "WatchdogUSec": "0"}} 2020-04-02T23:42:18.638 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:18 +0000 (0:00:00.048) 0:00:30.984 ******** 2020-04-02T23:42:18.802 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-02T23:42:18.803 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001612", "end": "2020-04-02 23:42:18.774767", "rc": 0, "start": "2020-04-02 23:42:18.773155", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:42:18.840 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:18 +0000 (0:00:00.201) 0:00:31.186 ******** 2020-04-02T23:42:18.856 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001731", "end": "2020-04-02 23:42:18.832422", "rc": 0, "start": "2020-04-02 23:42:18.830691", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:42:18.906 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:18 +0000 (0:00:00.065) 0:00:31.252 ******** 2020-04-02T23:42:19.757 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-02T23:42:19.759 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:42:19.804 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:19 +0000 (0:00:00.895) 0:00:32.147 ******** 2020-04-02T23:42:19.892 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:42:19.930 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:19 +0000 (0:00:00.129) 0:00:32.276 ******** 2020-04-02T23:42:20.714 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-02T23:42:20.716 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:42:20.752 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:20 +0000 (0:00:00.821) 0:00:33.098 ******** 2020-04-02T23:42:20.912 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:42:20.953 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:20 +0000 (0:00:00.200) 0:00:33.299 ******** 2020-04-02T23:42:22.037 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:42:22.078 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:22 +0000 (0:00:01.124) 0:00:34.424 ******** 2020-04-02T23:42:22.085 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:42:22.128 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:22 +0000 (0:00:00.049) 0:00:34.474 ******** 2020-04-02T23:42:38.496 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-02T23:42:38.498 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.163834", "end": "2020-04-02 23:42:38.470511", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:42:22.306677", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:42:38.539 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:38 +0000 (0:00:16.411) 0:00:50.886 ******** 2020-04-02T23:42:39.029 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-02T23:42:39.030 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:42:39.080 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:39 +0000 (0:00:00.540) 0:00:51.426 ******** 2020-04-02T23:42:39.170 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-02T23:42:39.172 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.879862", "end": "2020-04-02 23:42:39.147134", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:42:22.267272", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:42:39.214 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:39 +0000 (0:00:00.134) 0:00:51.560 ******** 2020-04-02T23:42:39.297 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.019920", "end": "2020-04-02 23:42:39.273914", "rc": 0, "start": "2020-04-02 23:42:39.253994", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:42:39.354 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:39 +0000 (0:00:00.139) 0:00:51.700 ******** 2020-04-02T23:42:39.556 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-02T23:42:39.557 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002169", "end": "2020-04-02 23:42:39.530530", "rc": 0, "start": "2020-04-02 23:42:39.528361", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:42:39.603 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:39 +0000 (0:00:00.249) 0:00:51.950 ******** 2020-04-02T23:42:39.758 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:42:39.797 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:39 +0000 (0:00:00.193) 0:00:52.143 ******** 2020-04-02T23:42:40.028 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-02T23:42:40.028 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010835", "end": "2020-04-02 23:42:39.996452", "rc": 0, "start": "2020-04-02 23:42:39.985617", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:42:40.077 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:40 +0000 (0:00:00.280) 0:00:52.423 ******** 2020-04-02T23:42:40.284 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-02T23:42:40.285 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002075", "end": "2020-04-02 23:42:40.263644", "rc": 0, "start": "2020-04-02 23:42:40.261569", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:42:40.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:40 +0000 (0:00:00.246) 0:00:52.670 ******** 2020-04-02T23:42:55.869 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-02T23:42:55.871 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.066951", "end": "2020-04-02 23:42:55.847479", "rc": 0, "start": "2020-04-02 23:42:39.780528", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:42:55.909 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:55 +0000 (0:00:15.584) 0:01:08.255 ******** 2020-04-02T23:42:56.111 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-02T23:42:56.113 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:42:56.150 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.241) 0:01:08.496 ******** 2020-04-02T23:42:56.176 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:42:56.176 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:42:56.213 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.063) 0:01:08.559 ******** 2020-04-02T23:42:56.249 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-02T23:42:56.251 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:42:56.287 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.074) 0:01:08.633 ******** 2020-04-02T23:42:56.323 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-02T23:42:56.324 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:42:56.362 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.074) 0:01:08.708 ******** 2020-04-02T23:42:56.398 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-02T23:42:56.399 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:42:56.437 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.075) 0:01:08.783 ******** 2020-04-02T23:42:56.629 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-02T23:42:56.631 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:42:56.666 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.228) 0:01:09.012 ******** 2020-04-02T23:42:56.861 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-02T23:42:56.863 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:42:56.903 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.235) 0:01:09.248 ******** 2020-04-02T23:42:56.927 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:42:56.929 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:56.964 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:56 +0000 (0:00:00.062) 0:01:09.310 ******** 2020-04-02T23:42:57.000 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-02T23:42:57.002 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:57.040 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:57 +0000 (0:00:00.074) 0:01:09.385 ******** 2020-04-02T23:42:57.262 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-02T23:42:57.263 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:42:57.299 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:57 +0000 (0:00:00.260) 0:01:09.645 ******** 2020-04-02T23:42:57.875 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-02T23:42:57.877 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:42:57.921 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:57 +0000 (0:00:00.622) 0:01:10.267 ******** 2020-04-02T23:42:57.958 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-02T23:42:57.959 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi082"}, "changed": false} 2020-04-02T23:42:57.996 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:57 +0000 (0:00:00.075) 0:01:10.342 ******** 2020-04-02T23:42:58.044 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-02T23:42:58.044 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:17.512822", "end": "2020-04-02 23:42:58.022458", "rc": 0, "start": "2020-04-02 23:42:40.509636", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:42:58.087 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:58 +0000 (0:00:00.091) 0:01:10.434 ******** 2020-04-02T23:42:58.308 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-02T23:42:58.309 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:42:58.358 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:58 +0000 (0:00:00.270) 0:01:10.704 ******** 2020-04-02T23:42:58.386 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:42:58.386 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:42:58.451 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:58 +0000 (0:00:00.085) 0:01:10.790 ******** 2020-04-02T23:42:58.487 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-02T23:42:58.488 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:42:58.531 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:58 +0000 (0:00:00.085) 0:01:10.875 ******** 2020-04-02T23:42:58.571 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-02T23:42:58.572 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:42:58.625 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:58 +0000 (0:00:00.096) 0:01:10.972 ******** 2020-04-02T23:42:58.669 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:42:58.701 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:58 +0000 (0:00:00.075) 0:01:11.047 ******** 2020-04-02T23:42:58.908 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-02T23:42:58.910 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:42:58.945 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:58 +0000 (0:00:00.244) 0:01:11.292 ******** 2020-04-02T23:42:58.994 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi082.front.sepia.ceph.com", "ansible_hostname": "smithi082", "ansible_nodename": "smithi082"}, "changed": true, "name": "smithi082"} 2020-04-02T23:42:59.034 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:59 +0000 (0:00:00.088) 0:01:11.380 ******** 2020-04-02T23:42:59.153 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-02T23:42:59.154 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:42:59.197 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:59 +0000 (0:00:00.163) 0:01:11.544 ******** 2020-04-02T23:42:59.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:42:59.232 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:59.273 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:59 +0000 (0:00:00.075) 0:01:11.619 ******** 2020-04-02T23:42:59.301 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-02T23:42:59.302 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:42:59.342 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:59 +0000 (0:00:00.068) 0:01:11.688 ******** 2020-04-02T23:42:59.499 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-02T23:42:59.500 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:42:59.539 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:59 +0000 (0:00:00.197) 0:01:11.885 ******** 2020-04-02T23:42:59.576 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-02T23:42:59.577 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:42:59.622 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:42:59 +0000 (0:00:00.083) 0:01:11.969 ******** 2020-04-02T23:43:00.003 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-02T23:43:00.004 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:43:00.049 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:00 +0000 (0:00:00.427) 0:01:12.396 ******** 2020-04-02T23:43:00.213 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:43:00.251 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:00 +0000 (0:00:00.201) 0:01:12.597 ******** 2020-04-02T23:43:00.278 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-02T23:43:00.278 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi050"}, "changed": false} 2020-04-02T23:43:00.319 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:00 +0000 (0:00:00.067) 0:01:12.665 ******** 2020-04-02T23:43:00.723 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi082.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:43:00.761 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:00 +0000 (0:00:00.441) 0:01:13.107 ******** 2020-04-02T23:43:00.762 INFO:teuthology.task.ansible.out: 2020-04-02T23:43:00.902 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-02T23:43:00.903 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi050.front.sepia.ceph.com", "ansible_hostname": "smithi050", "ansible_nodename": "smithi050"}, "changed": true, "name": "smithi050"} 2020-04-02T23:43:00.942 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:00 +0000 (0:00:00.181) 0:01:13.289 ******** 2020-04-02T23:43:01.239 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-02T23:43:01.240 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:43:01.279 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:01 +0000 (0:00:00.336) 0:01:13.625 ******** 2020-04-02T23:43:01.432 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-02T23:43:01.433 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:43:01.470 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:01 +0000 (0:00:00.191) 0:01:13.817 ******** 2020-04-02T23:43:01.477 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:43:01.478 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:43:01.519 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:01 +0000 (0:00:00.048) 0:01:13.865 ******** 2020-04-02T23:43:01.721 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:43:01.723 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:43:01.760 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:01 +0000 (0:00:00.241) 0:01:14.107 ******** 2020-04-02T23:43:01.945 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-02T23:43:01.945 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:43:01.991 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:01 +0000 (0:00:00.230) 0:01:14.337 ******** 2020-04-02T23:43:01.996 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:43:01.997 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:43:02.036 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:02 +0000 (0:00:00.045) 0:01:14.382 ******** 2020-04-02T23:43:02.521 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:43:02.522 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:43:02.562 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:02 +0000 (0:00:00.526) 0:01:14.909 ******** 2020-04-02T23:43:02.613 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi050.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:43:02.649 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:02 +0000 (0:00:00.086) 0:01:14.995 ******** 2020-04-02T23:43:03.050 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:43:03.050 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:43:03.095 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:03 +0000 (0:00:00.446) 0:01:15.441 ******** 2020-04-02T23:43:03.153 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-02T23:43:03.153 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:43:03.194 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:03 +0000 (0:00:00.098) 0:01:15.540 ******** 2020-04-02T23:43:03.410 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:43:03.411 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:43:03.447 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:03 +0000 (0:00:00.253) 0:01:15.793 ******** 2020-04-02T23:43:03.655 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:43:03.693 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:03 +0000 (0:00:00.245) 0:01:16.039 ******** 2020-04-02T23:43:03.919 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:43:03.920 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:43:03.961 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:03 +0000 (0:00:00.268) 0:01:16.307 ******** 2020-04-02T23:43:04.458 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:43:04.494 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:04 +0000 (0:00:00.533) 0:01:16.840 ******** 2020-04-02T23:43:04.828 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:43:04.830 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.538762", "end": "2020-04-02 23:43:04.802520", "rc": 0, "start": "2020-04-02 23:43:03.263758", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:04.872 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:04 +0000 (0:00:00.377) 0:01:17.218 ******** 2020-04-02T23:43:04.993 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:43:05.032 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:05 +0000 (0:00:00.160) 0:01:17.379 ******** 2020-04-02T23:43:05.371 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:43:05.372 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:43:05.852 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:43:06.300 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:43:06.341 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:06 +0000 (0:00:01.308) 0:01:18.687 ******** 2020-04-02T23:43:06.825 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-02T23:43:06.826 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:43:06.865 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:06 +0000 (0:00:00.524) 0:01:19.212 ******** 2020-04-02T23:43:07.007 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:43:07.008 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.772794", "end": "2020-04-02 23:43:06.983933", "rc": 0, "start": "2020-04-02 23:43:05.211139", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:07.045 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:07 +0000 (0:00:00.179) 0:01:19.391 ******** 2020-04-02T23:43:07.343 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:43:07.344 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:43:07.563 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:43:07.564 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:43:07.780 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:43:07.782 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:43:08.034 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi050.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:43:08.232 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi082.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:43:08.273 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:08 +0000 (0:00:01.226) 0:01:20.617 ******** 2020-04-02T23:43:08.516 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:43:08.517 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:43:08.558 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:08 +0000 (0:00:00.286) 0:01:20.904 ******** 2020-04-02T23:43:08.833 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-02T23:43:08.834 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.350192", "end": "2020-04-02 23:43:08.803090", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:43:08.452898", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-02T23:43:08.835 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-02T23:43:08.874 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:08 +0000 (0:00:00.316) 0:01:21.221 ******** 2020-04-02T23:43:08.911 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-02T23:43:08.913 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:08.957 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:08 +0000 (0:00:00.082) 0:01:21.303 ******** 2020-04-02T23:43:08.959 INFO:teuthology.task.ansible.out: 2020-04-02T23:43:08.996 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-02T23:43:08.997 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:09.007 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:09.047 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.089) 0:01:21.393 ******** 2020-04-02T23:43:09.063 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-02T23:43:09.064 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:43:09.105 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.057) 0:01:21.451 ******** 2020-04-02T23:43:09.111 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-02T23:43:09.112 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:09.158 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.053) 0:01:21.504 ******** 2020-04-02T23:43:09.195 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:43:09.234 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.076) 0:01:21.581 ******** 2020-04-02T23:43:09.271 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-02T23:43:09.273 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:09.313 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.078) 0:01:21.659 ******** 2020-04-02T23:43:09.348 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-02T23:43:09.350 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:09.387 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.073) 0:01:21.733 ******** 2020-04-02T23:43:09.603 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-02T23:43:09.604 INFO:teuthology.task.ansible.out:fatal: [smithi082.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006630", "end": "2020-04-02 23:43:09.581096", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:43:09.574466", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:43:09.643 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.256) 0:01:21.990 ******** 2020-04-02T23:43:09.650 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:43:09.651 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:43:09.684 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-02T23:43:09.686 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:09.742 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:09 +0000 (0:00:00.093) 0:01:22.083 ******** 2020-04-02T23:43:10.102 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:43:10.582 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:43:10.625 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:10 +0000 (0:00:00.888) 0:01:22.971 ******** 2020-04-02T23:43:11.194 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** changed: [smithi050.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.347800", "end": "2020-04-02 23:43:11.169677", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:43:10.821877", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-02T23:43:11.235 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.610) 0:01:23.582 ******** 2020-04-02T23:43:11.265 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-02T23:43:11.267 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:11.306 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.070) 0:01:23.652 ******** 2020-04-02T23:43:11.345 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-02T23:43:11.346 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:11.391 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.085) 0:01:23.738 ******** 2020-04-02T23:43:11.420 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-02T23:43:11.421 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:11.458 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.066) 0:01:23.804 ******** 2020-04-02T23:43:11.484 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:43:11.485 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:43:11.525 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.067) 0:01:23.871 ******** 2020-04-02T23:43:11.562 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-02T23:43:11.563 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:11.599 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.074) 0:01:23.946 ******** 2020-04-02T23:43:11.635 INFO:teuthology.task.ansible.out: 2020-04-02T23:43:11.637 INFO:teuthology.task.ansible.out:TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:11.671 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.071) 0:01:24.017 ******** 2020-04-02T23:43:11.887 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-02T23:43:11.888 INFO:teuthology.task.ansible.out:fatal: [smithi050.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006659", "end": "2020-04-02 23:43:11.868467", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:43:11.861808", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:43:11.930 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.258) 0:01:24.276 ******** 2020-04-02T23:43:11.956 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-02T23:43:11.958 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:11.995 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:11 +0000 (0:00:00.064) 0:01:24.341 ******** 2020-04-02T23:43:12.032 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:43:12.032 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:43:12.074 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:12 +0000 (0:00:00.078) 0:01:24.420 ******** 2020-04-02T23:43:14.360 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:43:14.396 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:14 +0000 (0:00:02.322) 0:01:26.742 ******** 2020-04-02T23:43:15.220 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:43:15.220 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:43:15.260 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:15 +0000 (0:00:00.863) 0:01:27.606 ******** 2020-04-02T23:43:17.633 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:43:17.671 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:17 +0000 (0:00:02.411) 0:01:30.017 ******** 2020-04-02T23:43:20.510 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-04-02T23:43:20.512 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:05.033608", "end": "2020-04-02 23:43:20.489574", "rc": 0, "start": "2020-04-02 23:43:15.455966", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 86 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 111 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 34 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 61 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:43:16 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:43:20.513 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 86 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 111 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 34 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 61 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:43:16 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:43:20.551 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:20 +0000 (0:00:02.879) 0:01:32.897 ******** 2020-04-02T23:43:23.053 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:05.165479", "end": "2020-04-02 23:43:23.031403", "rc": 0, "start": "2020-04-02 23:43:17.865924", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 123 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 35 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 65 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:43:18 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:43:23.054 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 123 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 35 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 65 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:43:18 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:43:23.092 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:23 +0000 (0:00:02.541) 0:01:35.438 ******** 2020-04-02T23:43:28.491 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:43:28.492 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:43:28.530 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:28 +0000 (0:00:05.437) 0:01:40.876 ******** 2020-04-02T23:43:28.557 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-02T23:43:28.559 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:28.595 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:28 +0000 (0:00:00.064) 0:01:40.941 ******** 2020-04-02T23:43:29.513 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:43:29.515 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:43:29.555 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:29 +0000 (0:00:00.959) 0:01:41.901 ******** 2020-04-02T23:43:29.582 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:43:29.583 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:29.622 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:29 +0000 (0:00:00.066) 0:01:41.968 ******** 2020-04-02T23:43:29.936 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service sysinit.target basic.target dbus.socket system.slice polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service ebtables.service shutdown.target ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-04-02T23:43:29.938 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-04-02T23:43:29.939 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-04-02T23:43:29.940 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:43:29.978 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:29 +0000 (0:00:00.356) 0:01:42.324 ******** 2020-04-02T23:43:30.275 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-02T23:43:30.276 INFO:teuthology.task.ansible.out:fatal: [smithi082.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:43:30.316 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:30 +0000 (0:00:00.337) 0:01:42.662 ******** 2020-04-02T23:43:31.006 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-02T23:43:31.008 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:43:31.045 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.728) 0:01:43.391 ******** 2020-04-02T23:43:31.075 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-02T23:43:31.076 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.114 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.068) 0:01:43.460 ******** 2020-04-02T23:43:31.142 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:43:31.183 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.067) 0:01:43.527 ******** 2020-04-02T23:43:31.221 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.259 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.077) 0:01:43.605 ******** 2020-04-02T23:43:31.296 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:43:31.298 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.341 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.081) 0:01:43.687 ******** 2020-04-02T23:43:31.380 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:43:31.381 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.422 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.081) 0:01:43.769 ******** 2020-04-02T23:43:31.450 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:43:31.452 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.492 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.069) 0:01:43.839 ******** 2020-04-02T23:43:31.520 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:43:31.567 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.074) 0:01:43.913 ******** 2020-04-02T23:43:31.593 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-02T23:43:31.594 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.637 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.069) 0:01:43.983 ******** 2020-04-02T23:43:31.649 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:43:31.686 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.049) 0:01:44.033 ******** 2020-04-02T23:43:31.701 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.735 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.048) 0:01:44.082 ******** 2020-04-02T23:43:31.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-02T23:43:31.742 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.781 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.045) 0:01:44.128 ******** 2020-04-02T23:43:31.787 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-02T23:43:31.789 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.828 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.046) 0:01:44.174 ******** 2020-04-02T23:43:31.854 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:43:31.863 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.893 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.065) 0:01:44.239 ******** 2020-04-02T23:43:31.919 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-02T23:43:31.921 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:31.958 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:31 +0000 (0:00:00.065) 0:01:44.305 ******** 2020-04-02T23:43:31.986 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.024 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.065) 0:01:44.370 ******** 2020-04-02T23:43:32.050 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-02T23:43:32.052 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.089 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.064) 0:01:44.435 ******** 2020-04-02T23:43:32.126 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:43:32.128 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.166 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.077) 0:01:44.512 ******** 2020-04-02T23:43:32.193 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-02T23:43:32.194 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.233 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.067) 0:01:44.580 ******** 2020-04-02T23:43:32.261 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:43:32.262 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.298 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.064) 0:01:44.644 ******** 2020-04-02T23:43:32.324 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-02T23:43:32.325 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.361 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.062) 0:01:44.707 ******** 2020-04-02T23:43:32.393 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-02T23:43:32.394 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.429 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.067) 0:01:44.775 ******** 2020-04-02T23:43:32.455 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-02T23:43:32.457 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.493 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.064) 0:01:44.839 ******** 2020-04-02T23:43:32.519 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:43:32.521 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.556 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.063) 0:01:44.903 ******** 2020-04-02T23:43:32.583 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:43:32.590 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.621 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.064) 0:01:44.967 ******** 2020-04-02T23:43:32.647 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:43:32.648 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.691 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.070) 0:01:45.037 ******** 2020-04-02T23:43:32.718 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:43:32.720 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.765 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.073) 0:01:45.111 ******** 2020-04-02T23:43:32.773 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:43:32.774 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:43:32.813 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.048) 0:01:45.160 ******** 2020-04-02T23:43:32.819 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:43:32.820 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.861 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.047) 0:01:45.207 ******** 2020-04-02T23:43:32.875 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:43:32.877 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.917 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.056) 0:01:45.263 ******** 2020-04-02T23:43:32.923 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:43:32.924 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:32.963 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:32 +0000 (0:00:00.045) 0:01:45.309 ******** 2020-04-02T23:43:32.988 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:43:32.990 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.043 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.080) 0:01:45.390 ******** 2020-04-02T23:43:33.073 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:43:33.074 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.134 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.090) 0:01:45.481 ******** 2020-04-02T23:43:33.161 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:43:33.163 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.200 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.065) 0:01:45.547 ******** 2020-04-02T23:43:33.237 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:43:33.239 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.274 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.073) 0:01:45.620 ******** 2020-04-02T23:43:33.280 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-02T23:43:33.283 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target system.slice dbus.service polkit.service basic.target dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service shutdown.target ip6tables.service ebtables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-02T23:43:33.284 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127461", "LimitNPROCSoft": "127461", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127461", 2020-04-02T23:43:33.286 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127461", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-02T23:43:33.287 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:43:33.331 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.056) 0:01:45.677 ******** 2020-04-02T23:43:33.337 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:43:33.338 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.375 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.044) 0:01:45.721 ******** 2020-04-02T23:43:33.400 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:43:33.402 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.437 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.061) 0:01:45.783 ******** 2020-04-02T23:43:33.465 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:43:33.467 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.501 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.064) 0:01:45.848 ******** 2020-04-02T23:43:33.527 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:43:33.529 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:33.564 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.063) 0:01:45.911 ******** 2020-04-02T23:43:33.653 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-02T23:43:33.655 INFO:teuthology.task.ansible.out:fatal: [smithi050.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:43:33.691 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.125) 0:01:46.036 ******** 2020-04-02T23:43:33.785 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:43:33.834 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:33 +0000 (0:00:00.143) 0:01:46.180 ******** 2020-04-02T23:43:33.990 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:43:34.033 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.199) 0:01:46.380 ******** 2020-04-02T23:43:34.069 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.101 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.068) 0:01:46.448 ******** 2020-04-02T23:43:34.108 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:43:34.109 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:43:34.148 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.046) 0:01:46.494 ******** 2020-04-02T23:43:34.154 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:43:34.195 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.045) 0:01:46.540 ******** 2020-04-02T23:43:34.220 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-02T23:43:34.221 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.258 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.064) 0:01:46.604 ******** 2020-04-02T23:43:34.287 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:43:34.289 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.323 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.065) 0:01:46.670 ******** 2020-04-02T23:43:34.351 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:43:34.352 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:43:34.390 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.066) 0:01:46.736 ******** 2020-04-02T23:43:34.397 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:43:34.398 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.399 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.443 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.053) 0:01:46.789 ******** 2020-04-02T23:43:34.449 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:43:34.450 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.490 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.046) 0:01:46.836 ******** 2020-04-02T23:43:34.495 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:43:34.498 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.538 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.047) 0:01:46.884 ******** 2020-04-02T23:43:34.544 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:43:34.547 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.584 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.046) 0:01:46.931 ******** 2020-04-02T23:43:34.589 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:43:34.627 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.042) 0:01:46.973 ******** 2020-04-02T23:43:34.633 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:43:34.635 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.672 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.044) 0:01:47.018 ******** 2020-04-02T23:43:34.676 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-02T23:43:34.677 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.713 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.041) 0:01:47.060 ******** 2020-04-02T23:43:34.726 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:43:34.728 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.763 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.049) 0:01:47.109 ******** 2020-04-02T23:43:34.768 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-02T23:43:34.769 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.807 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.044) 0:01:47.153 ******** 2020-04-02T23:43:34.813 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:43:34.813 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.853 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.045) 0:01:47.199 ******** 2020-04-02T23:43:34.858 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-02T23:43:34.859 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.898 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.045) 0:01:47.244 ******** 2020-04-02T23:43:34.903 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:43:34.903 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.941 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.042) 0:01:47.287 ******** 2020-04-02T23:43:34.948 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:43:34.950 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:34.984 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:34 +0000 (0:00:00.043) 0:01:47.330 ******** 2020-04-02T23:43:34.990 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:43:34.990 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.028 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.374 ******** 2020-04-02T23:43:35.033 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-02T23:43:35.033 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.071 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.418 ******** 2020-04-02T23:43:35.078 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:43:35.078 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.117 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.045) 0:01:47.463 ******** 2020-04-02T23:43:35.122 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:43:35.123 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.161 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.507 ******** 2020-04-02T23:43:35.168 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:43:35.170 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.206 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.044) 0:01:47.552 ******** 2020-04-02T23:43:35.210 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-02T23:43:35.211 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.248 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.042) 0:01:47.594 ******** 2020-04-02T23:43:35.254 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-02T23:43:35.255 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.295 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.046) 0:01:47.641 ******** 2020-04-02T23:43:35.300 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:43:35.301 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.338 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.685 ******** 2020-04-02T23:43:35.344 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-02T23:43:35.345 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.382 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.728 ******** 2020-04-02T23:43:35.387 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-02T23:43:35.389 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.426 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.772 ******** 2020-04-02T23:43:35.431 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:43:35.432 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.470 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.044) 0:01:47.817 ******** 2020-04-02T23:43:35.475 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:43:35.476 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.515 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.044) 0:01:47.861 ******** 2020-04-02T23:43:35.529 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.560 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.045) 0:01:47.907 ******** 2020-04-02T23:43:35.565 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-02T23:43:35.566 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.604 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.950 ******** 2020-04-02T23:43:35.609 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-02T23:43:35.611 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.647 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:47.994 ******** 2020-04-02T23:43:35.652 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-02T23:43:35.654 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.690 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.042) 0:01:48.036 ******** 2020-04-02T23:43:35.697 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-02T23:43:35.699 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.733 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.042) 0:01:48.079 ******** 2020-04-02T23:43:35.738 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-02T23:43:35.740 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.776 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:48.123 ******** 2020-04-02T23:43:35.781 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:43:35.783 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.819 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.042) 0:01:48.166 ******** 2020-04-02T23:43:35.824 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:43:35.825 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.862 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.042) 0:01:48.208 ******** 2020-04-02T23:43:35.866 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-02T23:43:35.869 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.904 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.042) 0:01:48.250 ******** 2020-04-02T23:43:35.911 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:43:35.912 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.947 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:48.294 ******** 2020-04-02T23:43:35.953 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-02T23:43:35.954 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:35.991 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:35 +0000 (0:00:00.043) 0:01:48.337 ******** 2020-04-02T23:43:35.996 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:43:35.997 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.043 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.052) 0:01:48.390 ******** 2020-04-02T23:43:36.049 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-02T23:43:36.051 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.088 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.044) 0:01:48.434 ******** 2020-04-02T23:43:36.093 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:43:36.093 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.131 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.042) 0:01:48.477 ******** 2020-04-02T23:43:36.139 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-02T23:43:36.140 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.050) 0:01:48.527 ******** 2020-04-02T23:43:36.187 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:43:36.187 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.226 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.044) 0:01:48.572 ******** 2020-04-02T23:43:36.231 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-02T23:43:36.232 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.270 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.044) 0:01:48.617 ******** 2020-04-02T23:43:36.276 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:43:36.277 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.315 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.044) 0:01:48.661 ******** 2020-04-02T23:43:36.320 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:43:36.321 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.359 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.043) 0:01:48.705 ******** 2020-04-02T23:43:36.367 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.406 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.047) 0:01:48.752 ******** 2020-04-02T23:43:36.412 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:43:36.412 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:43:36.450 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.043) 0:01:48.796 ******** 2020-04-02T23:43:36.455 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:43:36.457 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.496 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.045) 0:01:48.842 ******** 2020-04-02T23:43:36.502 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:43:36.502 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.504 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-02T23:43:36.515 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.515 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.516 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.559 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.063) 0:01:48.905 ******** 2020-04-02T23:43:36.565 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:43:36.565 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.566 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.609 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.050) 0:01:48.956 ******** 2020-04-02T23:43:36.627 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.653 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.043) 0:01:48.999 ******** 2020-04-02T23:43:36.690 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:43:36.691 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.728 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.074) 0:01:49.074 ******** 2020-04-02T23:43:36.754 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-02T23:43:36.756 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003419", "end": "2020-04-02 23:43:36.731555", "rc": 0, "start": "2020-04-02 23:43:36.728136", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Install packages] ********************************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.791 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.063) 0:01:49.138 ******** 2020-04-02T23:43:36.834 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.042) 0:01:49.180 ******** 2020-04-02T23:43:36.839 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:43:36.840 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.877 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.043) 0:01:49.224 ******** 2020-04-02T23:43:36.882 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-02T23:43:36.883 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.923 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.045) 0:01:49.269 ******** 2020-04-02T23:43:36.937 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:36.967 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:36 +0000 (0:00:00.044) 0:01:49.314 ******** 2020-04-02T23:43:36.972 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-02T23:43:36.973 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:37.010 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.042) 0:01:49.356 ******** 2020-04-02T23:43:37.037 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-02T23:43:37.038 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:37.073 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.063) 0:01:49.419 ******** 2020-04-02T23:43:37.099 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-02T23:43:37.105 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:37.135 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.062) 0:01:49.482 ******** 2020-04-02T23:43:37.193 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:43:37.193 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:43:37.230 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.093) 0:01:49.576 ******** 2020-04-02T23:43:37.454 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:43:37.455 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:43:37.490 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.260) 0:01:49.837 ******** 2020-04-02T23:43:37.707 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:43:37.708 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:43:37.747 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.256) 0:01:50.093 ******** 2020-04-02T23:43:37.773 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:43:37.774 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:37.812 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.065) 0:01:50.158 ******** 2020-04-02T23:43:37.855 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:43:37.857 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:37.919 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.106) 0:01:50.265 ******** 2020-04-02T23:43:37.946 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:43:37.948 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:37.987 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:37 +0000 (0:00:00.068) 0:01:50.334 ******** 2020-04-02T23:43:38.038 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:43:38.040 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.084 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.096) 0:01:50.430 ******** 2020-04-02T23:43:38.090 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-02T23:43:38.091 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:43:38.130 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.045) 0:01:50.476 ******** 2020-04-02T23:43:38.137 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:43:38.138 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.184 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.054) 0:01:50.531 ******** 2020-04-02T23:43:38.193 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:43:38.193 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item={u'block_used': 12911795, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183313, u'size_available': 930542850048, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990058, u'device': u'/dev/sda1', u'inode_used': 64918, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183313, "block_size": 4096, "block_total": 240095108, "block_used": 12911795, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990058, "inode_total": 61054976, "inode_used": 64918, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542850048, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:43:38.240 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.055) 0:01:50.586 ******** 2020-04-02T23:43:38.246 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.288 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.047) 0:01:50.634 ******** 2020-04-02T23:43:38.315 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:43:38.316 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.361 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.072) 0:01:50.707 ******** 2020-04-02T23:43:38.388 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:43:38.390 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.431 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.069) 0:01:50.777 ******** 2020-04-02T23:43:38.448 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-02T23:43:38.450 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004932", "end": "2020-04-02 23:43:38.416315", "rc": 0, "start": "2020-04-02 23:43:38.411383", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:38.451 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.493 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.062) 0:01:50.839 ******** 2020-04-02T23:43:38.531 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.038) 0:01:50.878 ******** 2020-04-02T23:43:38.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-02T23:43:38.538 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.583 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.051) 0:01:50.929 ******** 2020-04-02T23:43:38.589 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-02T23:43:38.590 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'block_used': 12911795, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183313, u'size_available': 930542850048, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990058, u'device': u'/dev/sda1', u'inode_used': 64918, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183313, "block_size": 4096, "block_total": 240095108, "block_used": 12911795, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990058, "inode_total": 61054976, "inode_used": 64918, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542850048, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.635 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.052) 0:01:50.982 ******** 2020-04-02T23:43:38.641 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-02T23:43:38.641 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.688 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.052) 0:01:51.034 ******** 2020-04-02T23:43:38.694 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-02T23:43:38.733 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.044) 0:01:51.079 ******** 2020-04-02T23:43:38.738 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:43:38.738 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.783 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.048) 0:01:51.128 ******** 2020-04-02T23:43:38.789 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:43:38.791 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5KFGK', u'wwn-0x5000c5009181c1f5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5KFGK', u'wwn': u'0x5000c5009181c1f5', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5KFGK-part1', u'wwn-0x5000c5009181c1f5-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5KFGK", "wwn-0x5000c5009181c1f5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5KFGK-part1", "wwn-0x5000c5009181c1f5-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5KFGK", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:43:38.792 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c5009181c1f5"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.815 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:43:38.816 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.861 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.069) 0:01:51.198 ******** 2020-04-02T23:43:38.878 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-02T23:43:38.878 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.913 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.061) 0:01:51.260 ******** 2020-04-02T23:43:38.939 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-02T23:43:38.941 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:38.977 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:38 +0000 (0:00:00.063) 0:01:51.323 ******** 2020-04-02T23:43:39.003 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:43:39.004 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.041 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.064) 0:01:51.388 ******** 2020-04-02T23:43:39.067 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-02T23:43:39.069 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.114 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.072) 0:01:51.460 ******** 2020-04-02T23:43:39.140 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-02T23:43:39.142 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.177 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.063) 0:01:51.524 ******** 2020-04-02T23:43:39.204 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-02T23:43:39.205 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.240 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.062) 0:01:51.586 ******** 2020-04-02T23:43:39.266 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-02T23:43:39.268 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.301 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.061) 0:01:51.647 ******** 2020-04-02T23:43:39.327 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-02T23:43:39.329 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.063) 0:01:51.711 ******** 2020-04-02T23:43:39.391 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:43:39.393 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.441 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.075) 0:01:51.787 ******** 2020-04-02T23:43:39.478 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:43:39.480 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:43:39.515 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.074) 0:01:51.861 ******** 2020-04-02T23:43:39.562 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:43:39.571 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.580 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-02T23:43:39.591 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.602 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.613 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.625 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.627 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.680 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.164) 0:01:52.026 ******** 2020-04-02T23:43:39.826 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-02T23:43:39.828 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003135", "end": "2020-04-02 23:43:39.802499", "rc": 0, "start": "2020-04-02 23:43:39.799364", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-02T23:43:39.867 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.186) 0:01:52.213 ******** 2020-04-02T23:43:39.903 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-02T23:43:39.905 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:39.944 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:39 +0000 (0:00:00.076) 0:01:52.290 ******** 2020-04-02T23:43:39.981 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-02T23:43:39.983 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:40.019 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:40 +0000 (0:00:00.075) 0:01:52.365 ******** 2020-04-02T23:43:40.052 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-02T23:43:40.054 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:40.090 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:40 +0000 (0:00:00.070) 0:01:52.436 ******** 2020-04-02T23:43:40.121 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:40.153 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:40 +0000 (0:00:00.063) 0:01:52.499 ******** 2020-04-02T23:43:40.299 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:43:40.300 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-5ksL2H-A6zP-zIjd-TJc1-AptL-A0Pp-BeKdPU', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400SD400BGN', u'nvme-nvme.8086-50484654363230343030534434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.316673", "end": "2020-04-02 23:43:40.267173", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5ksL2H-A6zP-zIjd-TJc1-AptL-A0Pp-BeKdPU", "nvme-INTEL_SSDPEDMD400G4_PHFT620400SD400BGN", "nvme-nvme.8086-50484654363230343030534434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:38.950500", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-02T23:43:40.301 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:41.285 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:43:41.327 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:41 +0000 (0:00:01.173) 0:01:53.673 ******** 2020-04-02T23:43:41.366 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:43:41.368 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'block_used': 12911800, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183308, u'size_available': 930542829568, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990067, u'device': u'/dev/sda1', u'inode_used': 64909, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183308, "block_size": 4096, "block_total": 240095108, "block_used": 12911800, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990067, "inode_total": 61054976, "inode_used": 64909, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542829568, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:43:41.405 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:41 +0000 (0:00:00.078) 0:01:53.752 ******** 2020-04-02T23:43:41.550 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:43:41.551 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3x26DUrJwv9t1mjsRGLTy3oFmYQNjnNRt'], u'uuids': [u'f6f37073-5bf2-4a9c-9db0-ce5250b42dc6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.056782", "end": "2020-04-02 23:43:41.520976", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3x26DUrJwv9t1mjsRGLTy3oFmYQNjnNRt"], "labels": [], "masters": [], "uuids": ["f6f37073-5bf2-4a9c-9db0-ce5250b42dc6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:40.464194", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:41.638 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-02T23:43:41.640 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005346", "end": "2020-04-02 23:43:41.609159", "rc": 0, "start": "2020-04-02 23:43:41.603813", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:41.679 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:41 +0000 (0:00:00.273) 0:01:54.025 ******** 2020-04-02T23:43:41.717 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-02T23:43:41.718 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'block_used': 12911800, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183308, u'size_available': 930542829568, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990067, u'device': u'/dev/sda1', u'inode_used': 64909, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183308, "block_size": 4096, "block_total": 240095108, "block_used": 12911800, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990067, "inode_total": 61054976, "inode_used": 64909, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542829568, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:41.768 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:41 +0000 (0:00:00.089) 0:01:54.115 ******** 2020-04-02T23:43:41.790 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-02T23:43:41.832 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:41 +0000 (0:00:00.063) 0:01:54.178 ******** 2020-04-02T23:43:41.869 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:43:41.870 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD', u'wwn-0x5000c500871ad2da'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HNFD', u'wwn': u'0x5000c500871ad2da', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1', u'wwn-0x5000c500871ad2da-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD", "wwn-0x5000c500871ad2da"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1", "wwn-0x5000c500871ad2da-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HNFD", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:43:41.872 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871ad2da"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:42.808 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3YJdXIKZ2fmJ0O50hanJd6ndD7JIZSiQx'], u'uuids': [u'b9f1516e-a81a-4f11-9941-94bb569e4217']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.062394", "end": "2020-04-02 23:43:42.778839", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3YJdXIKZ2fmJ0O50hanJd6ndD7JIZSiQx"], "labels": [], "masters": [], "uuids": ["b9f1516e-a81a-4f11-9941-94bb569e4217"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:41.716445", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:43.413 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-8wPYqW-VSJV-qnqO-DBjl-Xesk-9yx6-e0MXZQ', u'nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN', u'nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.339112", "end": "2020-04-02 23:43:43.378594", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-8wPYqW-VSJV-qnqO-DBjl-Xesk-9yx6-e0MXZQ", "nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN", "nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:42.039482", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2020-04-02T23:43:43.414 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:44.073 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3LmG9Tx7hM1pmeL4c5ui1fVpv4zWW1jF0'], u'uuids': [u'60f934c7-7b96-470a-8ebe-14c891f6bd75']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.064202", "end": "2020-04-02 23:43:44.036432", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3LmG9Tx7hM1pmeL4c5ui1fVpv4zWW1jF0"], "labels": [], "masters": [], "uuids": ["60f934c7-7b96-470a-8ebe-14c891f6bd75"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:42.972230", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:44.669 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmAEZ7rWnil2JtqFXD5lXzgX1aJcm8yc9O'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.044490", "end": "2020-04-02 23:43:44.631832", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmAEZ7rWnil2JtqFXD5lXzgX1aJcm8yc9O"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:43.587342", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:45.332 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3C5A3LuDMOpXLHPtb65l8MOwCxCVjsNII'], u'uuids': [u'1a013002-55b1-4f35-a6e2-ab8b4ae677f1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.042622", "end": "2020-04-02 23:43:45.294313", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3C5A3LuDMOpXLHPtb65l8MOwCxCVjsNII"], "labels": [], "masters": [], "uuids": ["1a013002-55b1-4f35-a6e2-ab8b4ae677f1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:44.251691", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:45.938 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmLBXAJBQHIwvWoZ70HUWgP1tEhCOIBrH7'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.057171", "end": "2020-04-02 23:43:45.898854", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmLBXAJBQHIwvWoZ70HUWgP1tEhCOIBrH7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:44.841683", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:46.604 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3IE09vZOANkWfOdWIYK0K100Li2DuZlYn'], u'uuids': [u'6cc6aa7d-3918-45fc-90cf-b54688723113']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.079569", "end": "2020-04-02 23:43:46.570700", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3IE09vZOANkWfOdWIYK0K100Li2DuZlYn"], "labels": [], "masters": [], "uuids": ["6cc6aa7d-3918-45fc-90cf-b54688723113"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:45.491131", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:46.651 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:46 +0000 (0:00:04.818) 0:01:58.997 ******** 2020-04-02T23:43:46.692 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5KFGK', u'wwn-0x5000c5009181c1f5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5KFGK', u'wwn': u'0x5000c5009181c1f5', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5KFGK-part1', u'wwn-0x5000c5009181c1f5-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5KFGK", "wwn-0x5000c5009181c1f5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5KFGK-part1", "wwn-0x5000c5009181c1f5-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsi 2020-04-02T23:43:46.693 INFO:teuthology.task.ansible.out:ze": "512", "serial": "Z1W5KFGK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009181c1f5"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:46.927 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-5ksL2H-A6zP-zIjd-TJc1-AptL-A0Pp-BeKdPU', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400SD400BGN', u'nvme-nvme.8086-50484654363230343030534434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037143", "end": "2020-04-02 23:43:46.899795", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5ksL2H-A6zP-zIjd-TJc1-AptL-A0Pp-BeKdPU", "nvme-INTEL_SSDPEDMD400G4_PHFT620400SD400BGN", "nvme-nvme.8086-50484654363230343030534434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:46.862652", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-02T23:43:46.928 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0344964 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0344964 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:47.197 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:43:47.198 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmkBOdquLF9Kx5ZLEz8yqHLFTkFM02iabY'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.046529", "end": "2020-04-02 23:43:47.157200", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmkBOdquLF9Kx5ZLEz8yqHLFTkFM02iabY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:46.110671", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:47.255 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:43:47.258 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3x26DUrJwv9t1mjsRGLTy3oFmYQNjnNRt'], u'uuids': [u'f6f37073-5bf2-4a9c-9db0-ce5250b42dc6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.143781", "end": "2020-04-02 23:43:47.234990", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3x26DUrJwv9t1mjsRGLTy3oFmYQNjnNRt"], "labels": [], "masters": [], "uuids": ["f6f37073-5bf2-4a9c-9db0-ce5250b42dc6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:47.091209", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14119 s, 817 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14119 s, 817 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:47.585 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3YJdXIKZ2fmJ0O50hanJd6ndD7JIZSiQx'], u'uuids': [u'b9f1516e-a81a-4f11-9941-94bb569e4217']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141868", "end": "2020-04-02 23:43:47.556210", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3YJdXIKZ2fmJ0O50hanJd6ndD7JIZSiQx"], "labels": [], "masters": [], "uuids": ["b9f1516e-a81a-4f11-9941-94bb569e4217"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:47.414342", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139325 s, 828 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139325 s, 828 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:47.923 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3LmG9Tx7hM1pmeL4c5ui1fVpv4zWW1jF0'], u'uuids': [u'60f934c7-7b96-470a-8ebe-14c891f6bd75']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.140475", "end": "2020-04-02 23:43:47.896734", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3LmG9Tx7hM1pmeL4c5ui1fVpv4zWW1jF0"], "labels": [], "masters": [], "uuids": ["60f934c7-7b96-470a-8ebe-14c891f6bd75"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:47.756259", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137966 s, 836 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137966 s, 836 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:48.257 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3C5A3LuDMOpXLHPtb65l8MOwCxCVjsNII'], u'uuids': [u'1a013002-55b1-4f35-a6e2-ab8b4ae677f1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.143474", "end": "2020-04-02 23:43:48.228621", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3C5A3LuDMOpXLHPtb65l8MOwCxCVjsNII"], "labels": [], "masters": [], "uuids": ["1a013002-55b1-4f35-a6e2-ab8b4ae677f1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:48.085147", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140905 s, 819 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140905 s, 819 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:48.444 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:43:48.445 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmGLG3xTkqy0EBPRTFMxuIxmBf53DMhCGA'], u'uuids': [u'705ada07-d566-4b88-b008-9493f46c266f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.047774", "end": "2020-04-02 23:43:48.416388", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmGLG3xTkqy0EBPRTFMxuIxmBf53DMhCGA"], "labels": [], "masters": [], "uuids": ["705ada07-d566-4b88-b008-9493f46c266f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:47.368614", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:48.584 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:43:48.586 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3IE09vZOANkWfOdWIYK0K100Li2DuZlYn'], u'uuids': [u'6cc6aa7d-3918-45fc-90cf-b54688723113']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140153", "end": "2020-04-02 23:43:48.555136", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-XlGPRo256fmHPIeO0DQvmxqZLtiU9Yb3IE09vZOANkWfOdWIYK0K100Li2DuZlYn"], "labels": [], "masters": [], "uuids": ["6cc6aa7d-3918-45fc-90cf-b54688723113"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:48.414983", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137649 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137649 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:48.638 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:48 +0000 (0:00:01.987) 0:02:00.985 ******** 2020-04-02T23:43:48.900 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi082.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.065009", "end": "2020-04-02 23:43:48.869847", "rc": 0, "start": "2020-04-02 23:43:48.804838", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:48.937 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:48 +0000 (0:00:00.298) 0:02:01.283 ******** 2020-04-02T23:43:49.187 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-02T23:43:49.189 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.050932", "end": "2020-04-02 23:43:49.162284", "rc": 0, "start": "2020-04-02 23:43:49.111352", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:49.229 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.291) 0:02:01.575 ******** 2020-04-02T23:43:49.255 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:43:49.294 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.065) 0:02:01.641 ******** 2020-04-02T23:43:49.320 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-02T23:43:49.321 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:49.361 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.066) 0:02:01.708 ******** 2020-04-02T23:43:49.406 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:49.445 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.083) 0:02:01.791 ******** 2020-04-02T23:43:49.472 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:43:49.474 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:49.513 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.067) 0:02:01.859 ******** 2020-04-02T23:43:49.549 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:43:49.551 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:49.594 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.081) 0:02:01.940 ******** 2020-04-02T23:43:49.753 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9Wgmgzmf7flRf1vgO1A6HHplFEZKGWaPEmj5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.077382", "end": "2020-04-02 23:43:49.708296", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9Wgmgzmf7flRf1vgO1A6HHplFEZKGWaPEmj5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:48.630914", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:43:49.799 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.205) 0:02:02.145 ******** 2020-04-02T23:43:49.806 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-02T23:43:49.806 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:43:49.848 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.048) 0:02:02.194 ******** 2020-04-02T23:43:49.854 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:43:49.855 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD', u'wwn-0x5000c500871ad2da'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HNFD', u'wwn': u'0x5000c500871ad2da', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1', u'wwn-0x5000c500871ad2da-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD", "wwn-0x5000c500871ad2da"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1", "wwn-0x5000c500871ad2da-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HNFD", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:43:49.857 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871ad2da"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:49.885 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:43:49.887 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={u'block_used': 12911795, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183313, u'size_available': 930542850048, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990058, u'device': u'/dev/sda1', u'inode_used': 64918, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183313, "block_size": 4096, "block_total": 240095108, "block_used": 12911795, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990058, "inode_total": 61054976, "inode_used": 64918, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542850048, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:49.925 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.077) 0:02:02.271 ******** 2020-04-02T23:43:49.961 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-02T23:43:49.963 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:50.000 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:49 +0000 (0:00:00.075) 0:02:02.346 ******** 2020-04-02T23:43:50.037 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:43:50.038 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:50.075 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:50 +0000 (0:00:00.074) 0:02:02.421 ******** 2020-04-02T23:43:50.091 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:43:50.092 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-8wPYqW-VSJV-qnqO-DBjl-Xesk-9yx6-e0MXZQ', u'nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN', u'nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036819", "end": "2020-04-02 23:43:50.056391", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-8wPYqW-VSJV-qnqO-DBjl-Xesk-9yx6-e0MXZQ", "nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN", "nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:50.019572", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 2020-04-02T23:43:50.094 INFO:teuthology.task.ansible.out: 0.0340159 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0340159 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:50.104 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:43:50.106 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:50.142 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:50 +0000 (0:00:00.066) 0:02:02.488 ******** 2020-04-02T23:43:50.179 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-02T23:43:50.181 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:50.220 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:50 +0000 (0:00:00.078) 0:02:02.567 ******** 2020-04-02T23:43:50.247 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-02T23:43:50.249 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:50.293 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:50 +0000 (0:00:00.072) 0:02:02.639 ******** 2020-04-02T23:43:50.321 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:43:50.323 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:50.359 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:50 +0000 (0:00:00.066) 0:02:02.706 ******** 2020-04-02T23:43:50.392 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:43:50.394 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmAEZ7rWnil2JtqFXD5lXzgX1aJcm8yc9O'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.094997", "end": "2020-04-02 23:43:50.349428", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmAEZ7rWnil2JtqFXD5lXzgX1aJcm8yc9O"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:50.254431", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0923507 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0923507 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:50.684 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmLBXAJBQHIwvWoZ70HUWgP1tEhCOIBrH7'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.095896", "end": "2020-04-02 23:43:50.659047", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmLBXAJBQHIwvWoZ70HUWgP1tEhCOIBrH7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:50.563151", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0932133 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0932133 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:50.997 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmkBOdquLF9Kx5ZLEz8yqHLFTkFM02iabY'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.094172", "end": "2020-04-02 23:43:50.972613", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmkBOdquLF9Kx5ZLEz8yqHLFTkFM02iabY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:50.878441", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0915861 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0915861 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:51.105 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-02T23:43:51.106 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:43:51.147 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:51 +0000 (0:00:00.787) 0:02:03.493 ******** 2020-04-02T23:43:51.291 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:43:51.292 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmGLG3xTkqy0EBPRTFMxuIxmBf53DMhCGA'], u'uuids': [u'705ada07-d566-4b88-b008-9493f46c266f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.094856", "end": "2020-04-02 23:43:51.259522", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9WgmGLG3xTkqy0EBPRTFMxuIxmBf53DMhCGA"], "labels": [], "masters": [], "uuids": ["705ada07-d566-4b88-b008-9493f46c266f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:51.164666", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0921588 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0921588 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:51.583 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9Wgmgzmf7flRf1vgO1A6HHplFEZKGWaPEmj5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.094554", "end": "2020-04-02 23:43:51.553730", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-V7Daa7v4zCv6e2E2eOjeVXTp119t9Wgmgzmf7flRf1vgO1A6HHplFEZKGWaPEmj5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:43:51.459176", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0919326 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0919326 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:51.632 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:51 +0000 (0:00:00.484) 0:02:03.978 ******** 2020-04-02T23:43:51.795 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:43:51.797 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:51.914 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-02T23:43:51.916 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.058523", "end": "2020-04-02 23:43:51.882630", "rc": 0, "start": "2020-04-02 23:43:51.824107", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:51.955 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:51 +0000 (0:00:00.323) 0:02:04.301 ******** 2020-04-02T23:43:52.118 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:43:52.119 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:52.202 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-02T23:43:52.203 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048010", "end": "2020-04-02 23:43:52.182136", "rc": 0, "start": "2020-04-02 23:43:52.134126", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:43:52.245 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.289) 0:02:04.591 ******** 2020-04-02T23:43:52.271 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:43:52.310 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.065) 0:02:04.656 ******** 2020-04-02T23:43:52.347 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-02T23:43:52.348 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:52.386 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.076) 0:02:04.733 ******** 2020-04-02T23:43:52.412 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-02T23:43:52.414 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:52.448 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.062) 0:02:04.795 ******** 2020-04-02T23:43:52.465 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:43:52.466 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:52.478 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:52.516 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.067) 0:02:04.862 ******** 2020-04-02T23:43:52.543 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:43:52.544 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:52.580 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.063) 0:02:04.926 ******** 2020-04-02T23:43:52.785 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-02T23:43:52.787 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:43:52.824 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.243) 0:02:05.170 ******** 2020-04-02T23:43:52.830 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:43:52.839 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:52.871 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:43:52.873 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'block_used': 12911800, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183308, u'size_available': 930542829568, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990067, u'device': u'/dev/sda1', u'inode_used': 64909, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183308, "block_size": 4096, "block_total": 240095108, "block_used": 12911800, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990067, "inode_total": 61054976, "inode_used": 64909, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542829568, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:52.909 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.085) 0:02:05.255 ******** 2020-04-02T23:43:52.936 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-02T23:43:52.938 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:52.975 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:52 +0000 (0:00:00.065) 0:02:05.321 ******** 2020-04-02T23:43:53.004 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:53.041 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.066) 0:02:05.388 ******** 2020-04-02T23:43:53.081 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:43:53.082 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:53.121 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.079) 0:02:05.467 ******** 2020-04-02T23:43:53.135 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:43:53.136 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:53.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.059) 0:02:05.527 ******** 2020-04-02T23:43:53.187 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-02T23:43:53.188 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:53.229 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.048) 0:02:05.576 ******** 2020-04-02T23:43:53.257 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-02T23:43:53.259 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:53.299 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.069) 0:02:05.645 ******** 2020-04-02T23:43:53.328 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:43:53.330 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:53.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.066) 0:02:05.712 ******** 2020-04-02T23:43:53.381 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:43:53.382 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-02T23:43:53.424 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.058) 0:02:05.770 ******** 2020-04-02T23:43:53.463 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:43:53.464 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:53.653 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:53.833 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:53.834 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-02T23:43:53.835 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:43:53.874 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:53 +0000 (0:00:00.450) 0:02:06.220 ******** 2020-04-02T23:43:54.017 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:43:54.018 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:54.211 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:54.250 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:54 +0000 (0:00:00.375) 0:02:06.596 ******** 2020-04-02T23:43:54.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:43:54.257 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:54.451 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-02T23:43:54.452 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:43:54.496 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:54 +0000 (0:00:00.242) 0:02:06.839 ******** 2020-04-02T23:43:54.532 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-02T23:43:54.533 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:43:54.575 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:54 +0000 (0:00:00.082) 0:02:06.921 ******** 2020-04-02T23:43:54.602 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:43:54.603 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:54.936 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:55.165 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-02T23:43:55.166 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:43:55.207 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:55 +0000 (0:00:00.631) 0:02:07.553 ******** 2020-04-02T23:43:55.271 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:55.610 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:43:55.652 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:55 +0000 (0:00:00.444) 0:02:07.998 ******** 2020-04-02T23:43:55.806 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-02T23:43:55.806 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-02T23:43:55.847 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:55 +0000 (0:00:00.195) 0:02:08.193 ******** 2020-04-02T23:43:55.873 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:43:55.875 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:55.915 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:55 +0000 (0:00:00.068) 0:02:08.262 ******** 2020-04-02T23:43:55.957 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:55 +0000 (0:00:00.041) 0:02:08.303 ******** 2020-04-02T23:43:55.962 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:43:55.963 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:55.986 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.023 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.066) 0:02:08.370 ******** 2020-04-02T23:43:56.052 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.088 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.064) 0:02:08.434 ******** 2020-04-02T23:43:56.114 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-02T23:43:56.116 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.156 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.068) 0:02:08.502 ******** 2020-04-02T23:43:56.165 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:43:56.166 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:56.188 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.226 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.069) 0:02:08.572 ******** 2020-04-02T23:43:56.227 INFO:teuthology.task.ansible.out: 2020-04-02T23:43:56.252 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-02T23:43:56.257 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.290 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.063) 0:02:08.636 ******** 2020-04-02T23:43:56.316 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-02T23:43:56.317 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.362 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.072) 0:02:08.708 ******** 2020-04-02T23:43:56.368 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:43:56.369 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:56.392 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-02T23:43:56.394 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.439 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.076) 0:02:08.785 ******** 2020-04-02T23:43:56.468 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-02T23:43:56.470 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.525 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.085) 0:02:08.871 ******** 2020-04-02T23:43:56.551 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-02T23:43:56.560 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.591 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.065) 0:02:08.937 ******** 2020-04-02T23:43:56.597 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:43:56.598 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:56.620 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-02T23:43:56.622 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:56.660 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.068) 0:02:09.006 ******** 2020-04-02T23:43:56.759 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:43:56.761 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:43:56.806 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:56 +0000 (0:00:00.146) 0:02:09.152 ******** 2020-04-02T23:43:57.019 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-02T23:43:57.021 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:43:57.058 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.252) 0:02:09.405 ******** 2020-04-02T23:43:57.095 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-02T23:43:57.096 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:43:57.135 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.076) 0:02:09.481 ******** 2020-04-02T23:43:57.142 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-02T23:43:57.143 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:43:57.186 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.050) 0:02:09.532 ******** 2020-04-02T23:43:57.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi050.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:43:57.410 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.224) 0:02:09.757 ******** 2020-04-02T23:43:57.491 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-02T23:43:57.494 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:41:30 UTC", "ActiveEnterTimestampMonotonic": "11644276", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target tmp.mount -.mount ntpd.service systemd-tmpfiles-setup.service system.slice ntpdate.service sntp.service systemd-journald.socket basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:41:29 UTC", "AssertTimestampMonotonic": "10428841", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:41:29 UTC", "ConditionTimestampMonotonic": "10428815", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-02T23:43:57.496 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2329", "ExecMainStartTimestamp": "Thu 2020-04-02 23:41:30 UTC", "ExecMainStartTimestampMonotonic": "11613468", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:41:29 UTC", "InactiveExitTimestampMonotonic": "10445303", "InvocationID": "31e668308e004e4291890317bcc79fd8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-02T23:43:57.497 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2329", "MemoryAccounting": "yes", "MemoryCurrent": "3096576", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-02T23:43:57.499 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:41:30 UTC", "StateChangeTimestampMonotonic": "11644276", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:41:30 UTC", "WatchdogTimestampMonotonic": "11613483", "WatchdogUSec": "0"}} 2020-04-02T23:43:57.539 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.128) 0:02:09.885 ******** 2020-04-02T23:43:57.568 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-02T23:43:57.569 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:57.607 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.068) 0:02:09.954 ******** 2020-04-02T23:43:57.638 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-02T23:43:57.639 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:57.680 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.072) 0:02:10.026 ******** 2020-04-02T23:43:57.709 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-02T23:43:57.710 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:57.751 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.071) 0:02:10.097 ******** 2020-04-02T23:43:57.757 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-02T23:43:57.758 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-02T23:43:57.806 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.054) 0:02:10.152 ******** 2020-04-02T23:43:57.833 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-02T23:43:57.835 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:57.892 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.085) 0:02:10.238 ******** 2020-04-02T23:43:57.918 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-02T23:43:57.919 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:57.956 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.064) 0:02:10.303 ******** 2020-04-02T23:43:57.962 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-02T23:43:57.963 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:43:58.002 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:57 +0000 (0:00:00.045) 0:02:10.349 ******** 2020-04-02T23:43:58.008 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-02T23:43:58.008 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.047 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.044) 0:02:10.393 ******** 2020-04-02T23:43:58.073 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-02T23:43:58.075 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.110 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.063) 0:02:10.456 ******** 2020-04-02T23:43:58.135 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-02T23:43:58.137 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.172 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.061) 0:02:10.518 ******** 2020-04-02T23:43:58.198 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-02T23:43:58.200 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.235 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.063) 0:02:10.581 ******** 2020-04-02T23:43:58.261 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-02T23:43:58.262 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.297 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.062) 0:02:10.643 ******** 2020-04-02T23:43:58.323 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-02T23:43:58.324 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.360 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.062) 0:02:10.706 ******** 2020-04-02T23:43:58.386 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-02T23:43:58.388 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.424 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.063) 0:02:10.770 ******** 2020-04-02T23:43:58.450 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-02T23:43:58.451 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.488 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.064) 0:02:10.835 ******** 2020-04-02T23:43:58.493 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-02T23:43:58.494 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:43:58.538 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.049) 0:02:10.884 ******** 2020-04-02T23:43:58.543 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-02T23:43:58.544 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:58.589 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:58 +0000 (0:00:00.050) 0:02:10.935 ******** 2020-04-02T23:43:59.119 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-02T23:43:59.119 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:43:59.161 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:59 +0000 (0:00:00.572) 0:02:11.508 ******** 2020-04-02T23:43:59.485 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-02T23:43:59.487 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:41:16 UTC", "ActiveEnterTimestampMonotonic": "10554146", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target sntp.service sysinit.target -.mount tmp.mount ntpdate.service systemd-journald.socket systemd-tmpfiles-setup.service ntpd.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:41:15 UTC", "AssertTimestampMonotonic": "9903099", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:41:15 UTC", "ConditionTimestampMonotonic": "9903066", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": 2020-04-02T23:43:59.488 INFO:teuthology.task.ansible.out:"NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1513", "ExecMainStartTimestamp": "Thu 2020-04-02 23:41:16 UTC", "ExecMainStartTimestampMonotonic": "10379601", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:41:15 UTC", "InactiveExitTimestampMonotonic": "10055874", "InvocationID": "a7695c06f0934938bd5b8449903e0a63", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216 2020-04-02T23:43:59.490 INFO:teuthology.task.ansible.out:", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127461", "LimitNPROCSoft": "127461", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127461", "LimitSIGPENDINGSoft": "127461", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1513", "MemoryAccounting": "yes", "MemoryCurrent": "3141632", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardErr 2020-04-02T23:43:59.491 INFO:teuthology.task.ansible.out:or": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:41:16 UTC", "StateChangeTimestampMonotonic": "10554146", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:41:16 UTC", "WatchdogTimestampMonotonic": "10379612", "WatchdogUSec": "0"}} 2020-04-02T23:43:59.526 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:59 +0000 (0:00:00.364) 0:02:11.872 ******** 2020-04-02T23:43:59.554 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-02T23:43:59.555 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:59.594 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:59 +0000 (0:00:00.067) 0:02:11.940 ******** 2020-04-02T23:43:59.627 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:59.663 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:59 +0000 (0:00:00.067) 0:02:12.008 ******** 2020-04-02T23:43:59.690 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-02T23:43:59.692 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:59.726 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:59 +0000 (0:00:00.064) 0:02:12.073 ******** 2020-04-02T23:43:59.862 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-02T23:43:59.863 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:43:59.902 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:59 +0000 (0:00:00.175) 0:02:12.248 ******** 2020-04-02T23:43:59.928 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-02T23:43:59.930 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:43:59.966 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:43:59 +0000 (0:00:00.063) 0:02:12.312 ******** 2020-04-02T23:43:59.971 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-02T23:43:59.972 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:44:00.013 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.047) 0:02:12.359 ******** 2020-04-02T23:44:00.019 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-02T23:44:00.019 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-02T23:44:00.061 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.047) 0:02:12.407 ******** 2020-04-02T23:44:00.253 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-02T23:44:00.255 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:44:00.290 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.229) 0:02:12.637 ******** 2020-04-02T23:44:00.317 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-02T23:44:00.319 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:00.360 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.066) 0:02:12.703 ******** 2020-04-02T23:44:00.385 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi082.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:44:00.424 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.066) 0:02:12.770 ******** 2020-04-02T23:44:00.451 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-02T23:44:00.453 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:00.487 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.063) 0:02:12.834 ******** 2020-04-02T23:44:00.525 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-02T23:44:00.526 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:44:00.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.083) 0:02:12.918 ******** 2020-04-02T23:44:00.682 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-02T23:44:00.683 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:44:00.723 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.151) 0:02:13.069 ******** 2020-04-02T23:44:00.918 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-02T23:44:00.919 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-02T23:44:00.956 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:00 +0000 (0:00:00.233) 0:02:13.302 ******** 2020-04-02T23:44:00.982 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-02T23:44:00.984 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.018 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.062) 0:02:13.365 ******** 2020-04-02T23:44:01.057 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-02T23:44:01.058 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.069 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.069 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.080 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.124 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.103) 0:02:13.469 ******** 2020-04-02T23:44:01.160 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi082.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.161 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.178 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi082.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.190 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.235 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.112) 0:02:13.581 ******** 2020-04-02T23:44:01.261 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.300 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.065) 0:02:13.646 ******** 2020-04-02T23:44:01.327 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-02T23:44:01.329 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.065) 0:02:13.712 ******** 2020-04-02T23:44:01.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-02T23:44:01.403 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.450 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.084) 0:02:13.796 ******** 2020-04-02T23:44:01.477 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-02T23:44:01.479 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.516 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.066) 0:02:13.862 ******** 2020-04-02T23:44:01.543 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-02T23:44:01.545 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.585 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.068) 0:02:13.931 ******** 2020-04-02T23:44:01.612 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:44:01.614 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.655 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.069) 0:02:14.001 ******** 2020-04-02T23:44:01.661 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-02T23:44:01.663 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:44:01.705 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.049) 0:02:14.051 ******** 2020-04-02T23:44:01.710 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-02T23:44:01.712 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.756 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.050) 0:02:14.102 ******** 2020-04-02T23:44:01.761 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-02T23:44:01.762 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.802 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.045) 0:02:14.148 ******** 2020-04-02T23:44:01.808 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:44:01.809 INFO:teuthology.task.ansible.out:skipping: [smithi082.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:01.848 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.046) 0:02:14.194 ******** 2020-04-02T23:44:01.853 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-02T23:44:01.853 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-04-02T23:44:01.891 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:01 +0000 (0:00:00.043) 0:02:14.237 ******** 2020-04-02T23:44:02.073 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi082.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004686", "end": "2020-04-02 23:44:02.036818", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:44:02.032132", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:02.093 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-02T23:44:02.094 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:44:02.130 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.239) 0:02:14.476 ******** 2020-04-02T23:44:02.157 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-02T23:44:02.158 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.195 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.064) 0:02:14.542 ******** 2020-04-02T23:44:02.223 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-02T23:44:02.225 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:44:02.259 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.064) 0:02:14.606 ******** 2020-04-02T23:44:02.266 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:44:02.266 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002936", "end": "2020-04-02 23:44:02.223932", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:44:02.220996", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:02.297 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.326 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.066) 0:02:14.672 ******** 2020-04-02T23:44:02.530 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:44:02.568 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.242) 0:02:14.914 ******** 2020-04-02T23:44:02.773 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-02T23:44:02.812 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.244) 0:02:15.158 ******** 2020-04-02T23:44:02.840 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-02T23:44:02.841 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.878 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.065) 0:02:15.225 ******** 2020-04-02T23:44:02.917 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-02T23:44:02.918 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.929 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.930 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.940 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.942 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-04-02T23:44:02.981 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:02 +0000 (0:00:00.102) 0:02:15.327 ******** 2020-04-02T23:44:03.018 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-02T23:44:03.019 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.029 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.030 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.041 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.042 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.081 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.100) 0:02:15.428 ******** 2020-04-02T23:44:03.107 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:44:03.109 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.148 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.066) 0:02:15.494 ******** 2020-04-02T23:44:03.174 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-02T23:44:03.175 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.211 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.063) 0:02:15.557 ******** 2020-04-02T23:44:03.237 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-02T23:44:03.238 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.277 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.066) 0:02:15.624 ******** 2020-04-02T23:44:03.308 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-02T23:44:03.309 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.357 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.079) 0:02:15.703 ******** 2020-04-02T23:44:03.394 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-02T23:44:03.395 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.439 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.082) 0:02:15.785 ******** 2020-04-02T23:44:03.456 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:44:03.456 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:01.003895", "end": "2020-04-02 23:44:03.426050", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:44:02.422155", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:03.468 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.512 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.069) 0:02:15.855 ******** 2020-04-02T23:44:03.535 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-02T23:44:03.536 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.579 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.069) 0:02:15.925 ******** 2020-04-02T23:44:03.607 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:44:03.608 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:44:03.647 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.068) 0:02:15.993 ******** 2020-04-02T23:44:03.673 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:44:03.674 INFO:teuthology.task.ansible.out:ok: [smithi082.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.016342", "end": "2020-04-02 23:44:03.634705", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:44:03.618363", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:03.716 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.069) 0:02:16.063 ******** 2020-04-02T23:44:03.743 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-02T23:44:03.781 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:03 +0000 (0:00:00.064) 0:02:16.127 ******** 2020-04-02T23:44:03.880 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:44:03.881 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005299", "end": "2020-04-02 23:44:03.844593", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:44:03.839294", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:03.976 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-02T23:44:03.978 INFO:teuthology.task.ansible.out:changed: [smithi082.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:44:04.079 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:44:04.081 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003113", "end": "2020-04-02 23:44:04.051443", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:44:04.048330", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:04.279 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002944", "end": "2020-04-02 23:44:04.249010", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:44:04.246066", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:04.502 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025410", "end": "2020-04-02 23:44:04.469747", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:44:04.444337", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:44:04.539 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:04 +0000 (0:00:00.757) 0:02:16.885 ******** 2020-04-02T23:44:04.565 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-02T23:44:04.603 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:44:04 +0000 (0:00:00.064) 0:02:16.949 ******** 2020-04-02T23:44:04.814 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-02T23:44:04.814 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:44:04.916 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-04-02T23:44:04.918 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-04-02T23:44:04.919 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-04-02T23:44:04.923 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-04-02T23:44:04.925 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi050.front.sepia.ceph.com : ok=111 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi082.front.sepia.ceph.com : ok=111 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Thursday 02 April 2020 23:44:04 +0000 (0:00:00.321) 0:02:17.270 ******** =============================================================================== 2020-04-02T23:44:04.926 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 16.41s common : nrpe - Load SELinux policy package ---------------------------- 15.58s testnode : Install packages --------------------------------------------- 5.44s testnode : Zap all non-root disks --------------------------------------- 4.82s common : Install Kerberos Packages (RedHat) ----------------------------- 3.12s testnode : Base group workaround for BZ1782899 -------------------------- 2.88s Gathering Facts --------------------------------------------------------- 2.69s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.38s testnode : Rebuild rpmdb ------------------------------------------------ 1.31s testnode : Configure local mirrorlists ---------------------------------- 1.23s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.23s testnode : Make sure rpm dependencies are installed --------------------- 1.17s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.12s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.98s common : Make sure smartmontools is installed --------------------------- 0.96s common : Configure local epel mirrorlists ------------------------------- 0.92s common : nrpe - Install SELinux dependencies ---------------------------- 0.90s testnode : Ensure ceph dependency packages are not present. ------------- 0.86s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.85s common : nrpe - Ensure SELinux policy is up to date --------------------- 0.82s 2020-04-02T23:44:05.205 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2020-04-02T23:44:05.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:44:05.208 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:44:05.279 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:05.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:44:05.376 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi082.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:44:05.449 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:05.537 INFO:teuthology.run_tasks:Running task clock... 2020-04-02T23:44:05.556 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-02T23:44:05.556 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:05.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:44:05.571 INFO:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:44:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:44:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:44:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2020-04-02T23:44:05.760 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:44:05.780 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2020-04-02T23:44:05.793 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:44:05.845 INFO:teuthology.orchestra.run.smithi050.stdout:210 Number of sources = 4 2020-04-02T23:44:05.846 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:44:05.846 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2020-04-02T23:44:05.846 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:05.846 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:05.846 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:05.846 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2020-04-02T23:44:05.858 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:05.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:44:05.874 INFO:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:44:05.982 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:44:05.982 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:44:06.033 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2020-04-02T23:44:06.049 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2020-04-02T23:44:06.049 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:44:06.084 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:44:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2020-04-02T23:44:06.151 INFO:teuthology.orchestra.run.smithi082.stdout:210 Number of sources = 4 2020-04-02T23:44:06.151 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:44:06.151 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2020-04-02T23:44:06.151 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:06.151 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:06.151 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:06.152 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:44:06.161 INFO:teuthology.run_tasks:Running task install... 2020-04-02T23:44:06.170 DEBUG:teuthology.task.install:project ceph 2020-04-02T23:44:06.170 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}} 2020-04-02T23:44:06.171 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:44:06.171 INFO:teuthology.task.install:Using flavor: basic 2020-04-02T23:44:06.178 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-02T23:44:06.179 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-04-02T23:44:06.179 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:06.206 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2020-04-02T23:44:06.288 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS 2020-04-02T23:44:06.289 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:44:06.289 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:06.290 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-02T23:44:06.290 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:06.303 INFO:teuthology.orchestra.run.smithi082:> sudo lsb_release -is 2020-04-02T23:44:06.343 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2020-04-02T23:44:06.379 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS 2020-04-02T23:44:06.380 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:44:06.381 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-02T23:44:06.381 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:06.423 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS 2020-04-02T23:44:06.424 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:44:06.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:44:06.434 INFO:teuthology.orchestra.run.smithi082:> sudo lsb_release -is 2020-04-02T23:44:06.509 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS 2020-04-02T23:44:06.510 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:44:06.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:44:06.682 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/ 2020-04-02T23:44:06.682 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:44:06.751 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/ 2020-04-02T23:44:06.751 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:44:06.865 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:44:06.866 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:06.885 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:44:06.936 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:44:06.937 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:06.950 INFO:teuthology.orchestra.run.smithi082:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:44:06.971 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:44:06.972 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:07.028 INFO:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:44:07.036 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:44:07.036 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:07.089 INFO:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:44:07.107 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:07.161 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:07.163 INFO:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:44:07.215 INFO:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:44:07.260 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:07.275 INFO:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:44:07.298 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2020-04-02T23:44:07.351 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:07.352 INFO:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:44:07.411 INFO:teuthology.orchestra.run.smithi050:> sudo yum clean all 2020-04-02T23:44:07.419 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2020-04-02T23:44:07.421 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:07.483 INFO:teuthology.orchestra.run.smithi082:> sudo yum clean all 2020-04-02T23:44:07.710 INFO:teuthology.orchestra.run.smithi050.stdout:50 files removed 2020-04-02T23:44:07.739 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:44:07.753 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:44:07.757 INFO:teuthology.orchestra.run.smithi082.stdout:50 files removed 2020-04-02T23:44:07.786 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:44:07.800 INFO:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:44:08.549 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 180 kB/s | 69 kB 00:00 2020-04-02T23:44:08.562 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 180 kB/s | 69 kB 00:00 2020-04-02T23:44:08.893 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-02T23:44:08.903 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-02T23:44:09.228 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-02T23:44:09.235 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-02T23:44:09.433 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - AppStream 38 MB/s | 6.6 MB 00:00 2020-04-02T23:44:09.453 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - AppStream 36 MB/s | 6.6 MB 00:00 2020-04-02T23:44:10.597 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - Base 42 MB/s | 5.0 MB 00:00 2020-04-02T23:44:10.686 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Base 41 MB/s | 5.0 MB 00:00 2020-04-02T23:44:11.373 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - Extras 68 kB/s | 4.4 kB 00:00 2020-04-02T23:44:11.505 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Extras 70 kB/s | 4.4 kB 00:00 2020-04-02T23:44:11.527 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for ceph-el8 owned by ktdreyer 435 kB/s | 47 kB 00:00 2020-04-02T23:44:11.650 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for ceph-el8 owned by ktdreyer 487 kB/s | 47 kB 00:00 2020-04-02T23:44:11.892 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 20 MB/s | 6.2 MB 00:00 2020-04-02T23:44:12.054 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 18 MB/s | 6.2 MB 00:00 2020-04-02T23:44:13.170 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 6.1 MB/s | 30 kB 00:00 2020-04-02T23:44:13.405 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 6.1 MB/s | 30 kB 00:00 2020-04-02T23:44:14.040 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:44:14.040 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:44:14.043 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:44:14.044 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:44:14.045 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:44:14.045 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:44:14.168 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2020-04-02T23:44:14.180 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:44:14.180 INFO:teuthology.orchestra.run.smithi082.stdout: Package ArchVersion Repository Size 2020-04-02T23:44:14.180 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:44:14.180 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2020-04-02T23:44:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:44:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:44:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 573 k 2020-04-02T23:44:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 203 k 2020-04-02T23:44:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:44:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.8 M 2020-04-02T23:44:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 42 M 2020-04-02T23:44:14.182 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:44:14.182 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:44:14.182 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 508 k 2020-04-02T23:44:14.182 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:44:14.182 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:44:14.182 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:44:14.182 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:44:14.183 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:44:14.183 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 72 k 2020-04-02T23:44:14.183 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.7 M 2020-04-02T23:44:14.183 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:44:14.183 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:44:14.183 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:44:14.184 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:44:14.184 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:44:14.185 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:44:14.185 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:44:14.186 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:44:14.186 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:44:14.186 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:44:14.186 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:44:14.186 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:44:14.186 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:44:14.186 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2020-04-02T23:44:14.187 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:44:14.187 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.9 M 2020-04-02T23:44:14.187 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2020-04-02T23:44:14.187 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:44:14.187 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:44:14.187 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:44:14.188 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:44:14.188 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:44:14.188 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 377 k 2020-04-02T23:44:14.188 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:44:14.191 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:44:14.191 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:44:14.192 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:44:14.192 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:44:14.192 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:44:14.192 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:44:14.192 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:44:14.193 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:44:14.193 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:44:14.193 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:44:14.193 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:44:14.193 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:44:14.193 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:44:14.193 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:44:14.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:44:14.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:44:14.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:44:14.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:44:14.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:44:14.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:44:14.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:44:14.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:44:14.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:44:14.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:44:14.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:44:14.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:44:14.196 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:44:14.196 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:44:14.197 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:44:14.197 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:44:14.197 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:44:14.197 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:44:14.198 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:44:14.198 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:44:14.198 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:44:14.198 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:44:14.198 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:44:14.198 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:44:14.198 INFO:teuthology.orchestra.run.smithi082.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:44:14.199 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:44:14.200 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:44:14.200 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:44:14.200 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:44:14.200 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:44:14.200 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:44:14.200 INFO:teuthology.orchestra.run.smithi082.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:44:14.200 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:44:14.201 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:44:14.202 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:44:14.202 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:44:14.202 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:44:14.202 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:44:14.202 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:44:14.202 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:44:14.202 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:44:14.203 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:44:14.203 INFO:teuthology.orchestra.run.smithi082.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:44:14.203 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:44:14.203 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:44:14.203 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:44:14.203 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:44:14.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:44:14.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:44:14.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:44:14.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:44:14.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:44:14.206 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:44:14.206 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2020-04-02T23:44:14.206 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2020-04-02T23:44:14.206 INFO:teuthology.orchestra.run.smithi082.stdout:Install 123 Packages 2020-04-02T23:44:14.206 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 2 Packages 2020-04-02T23:44:14.206 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:44:14.207 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 174 M 2020-04-02T23:44:14.207 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2020-04-02T23:44:14.333 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:44:14.334 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:44:14.338 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:44:14.338 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:44:14.339 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:44:14.339 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:44:14.349 INFO:teuthology.orchestra.run.smithi082.stdout:(1/125): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 42 kB/s | 6.4 kB 00:00 2020-04-02T23:44:14.475 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2020-04-02T23:44:14.489 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:44:14.489 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2020-04-02T23:44:14.489 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:44:14.489 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2020-04-02T23:44:14.490 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:44:14.490 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:44:14.490 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 573 k 2020-04-02T23:44:14.490 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 203 k 2020-04-02T23:44:14.490 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:44:14.490 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.8 M 2020-04-02T23:44:14.490 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 42 M 2020-04-02T23:44:14.491 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:44:14.491 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:44:14.491 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 508 k 2020-04-02T23:44:14.491 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:44:14.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:44:14.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:44:14.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:44:14.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:44:14.492 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 72 k 2020-04-02T23:44:14.492 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.7 M 2020-04-02T23:44:14.492 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:44:14.492 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:44:14.492 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:44:14.492 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:44:14.493 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:44:14.494 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:44:14.494 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2020-04-02T23:44:14.494 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:44:14.494 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.9 M 2020-04-02T23:44:14.494 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2020-04-02T23:44:14.494 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:44:14.494 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 377 k 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:44:14.495 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:44:14.496 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:44:14.496 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:44:14.496 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:44:14.496 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:44:14.496 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:44:14.496 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:44:14.502 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:44:14.502 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:44:14.502 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:44:14.502 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:44:14.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:44:14.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:44:14.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:44:14.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:44:14.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:44:14.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:44:14.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:44:14.504 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:44:14.504 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:44:14.504 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:44:14.504 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:44:14.504 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:44:14.504 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:44:14.504 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:44:14.505 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:44:14.505 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:44:14.505 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:44:14.505 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:44:14.505 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:44:14.505 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:44:14.505 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:44:14.506 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:44:14.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:44:14.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:44:14.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:44:14.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:44:14.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:44:14.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:44:14.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:44:14.508 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:44:14.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:44:14.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:44:14.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:44:14.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:44:14.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:44:14.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:44:14.513 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:44:14.514 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:44:14.514 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:44:14.514 INFO:teuthology.orchestra.run.smithi050.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:44:14.514 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:44:14.514 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:44:14.514 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:44:14.514 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:44:14.515 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:44:14.516 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:44:14.516 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:44:14.516 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:44:14.516 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:44:14.517 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:44:14.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:44:14.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:44:14.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:44:14.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:44:14.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:44:14.518 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:44:14.518 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:44:14.518 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:44:14.518 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:44:14.518 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:44:14.518 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:44:14.518 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:44:14.519 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:44:14.519 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:44:14.519 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2020-04-02T23:44:14.519 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:44:14.519 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:44:14.519 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:44:14.519 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2020-04-02T23:44:14.520 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2020-04-02T23:44:14.520 INFO:teuthology.orchestra.run.smithi050.stdout:Install 123 Packages 2020-04-02T23:44:14.520 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2020-04-02T23:44:14.520 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:44:14.521 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 174 M 2020-04-02T23:44:14.521 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2020-04-02T23:44:14.576 INFO:teuthology.orchestra.run.smithi082.stdout:(2/125): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 2.5 MB/s | 573 kB 00:00 2020-04-02T23:44:14.618 INFO:teuthology.orchestra.run.smithi082.stdout:(3/125): ceph-immutable-object-cache-16.0.0-316 4.8 MB/s | 203 kB 00:00 2020-04-02T23:44:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:(1/125): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 38 kB/s | 6.4 kB 00:00 2020-04-02T23:44:14.909 INFO:teuthology.orchestra.run.smithi082.stdout:(4/125): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 7.0 MB/s | 2.0 MB 00:00 2020-04-02T23:44:15.020 INFO:teuthology.orchestra.run.smithi082.stdout:(5/125): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 6.8 MB/s | 5.6 MB 00:00 2020-04-02T23:44:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:(6/125): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_6 7.2 MB/s | 1.4 MB 00:00 2020-04-02T23:44:15.339 INFO:teuthology.orchestra.run.smithi050.stdout:(2/125): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 860 kB/s | 573 kB 00:00 2020-04-02T23:44:15.537 INFO:teuthology.orchestra.run.smithi082.stdout:(7/125): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_6 8.4 MB/s | 4.4 MB 00:00 2020-04-02T23:44:15.572 INFO:teuthology.orchestra.run.smithi050.stdout:(3/125): ceph-immutable-object-cache-16.0.0-316 871 kB/s | 203 kB 00:00 2020-04-02T23:44:16.764 INFO:teuthology.orchestra.run.smithi082.stdout:(8/125): ceph-common-16.0.0-316.gcbb84f7.el8.x8 8.1 MB/s | 21 MB 00:02 2020-04-02T23:44:16.902 INFO:teuthology.orchestra.run.smithi082.stdout:(9/125): ceph-radosgw-16.0.0-316.gcbb84f7.el8.x 7.2 MB/s | 9.8 MB 00:01 2020-04-02T23:44:16.984 INFO:teuthology.orchestra.run.smithi082.stdout:(10/125): ceph-selinux-16.0.0-316.gcbb84f7.el8. 112 kB/s | 25 kB 00:00 2020-04-02T23:44:17.051 INFO:teuthology.orchestra.run.smithi082.stdout:(11/125): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 593 kB/s | 39 kB 00:00 2020-04-02T23:44:17.114 INFO:teuthology.orchestra.run.smithi082.stdout:(12/125): libcephfs-devel-16.0.0-316.gcbb84f7.e 340 kB/s | 21 kB 00:00 2020-04-02T23:44:17.142 INFO:teuthology.orchestra.run.smithi050.stdout:(4/125): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 2.1 MB/s | 5.6 MB 00:02 2020-04-02T23:44:17.201 INFO:teuthology.orchestra.run.smithi050.stdout:(5/125): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 1.3 MB/s | 2.0 MB 00:01 2020-04-02T23:44:17.282 INFO:teuthology.orchestra.run.smithi082.stdout:(13/125): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_ 7.6 MB/s | 17 MB 00:02 2020-04-02T23:44:17.287 INFO:teuthology.orchestra.run.smithi082.stdout:(14/125): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 2.9 MB/s | 508 kB 00:00 2020-04-02T23:44:17.333 INFO:teuthology.orchestra.run.smithi082.stdout:(15/125): librados-devel-16.0.0-316.gcbb84f7.el 2.7 MB/s | 141 kB 00:00 2020-04-02T23:44:17.351 INFO:teuthology.orchestra.run.smithi082.stdout:(16/125): libradosstriper1-16.0.0-316.gcbb84f7. 5.7 MB/s | 377 kB 00:00 2020-04-02T23:44:17.368 INFO:teuthology.orchestra.run.smithi050.stdout:(6/125): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_6 6.3 MB/s | 1.4 MB 00:00 2020-04-02T23:44:17.406 INFO:teuthology.orchestra.run.smithi082.stdout:(17/125): python3-ceph-argparse-16.0.0-316.gcbb 728 kB/s | 40 kB 00:00 2020-04-02T23:44:17.476 INFO:teuthology.orchestra.run.smithi082.stdout:(18/125): python3-ceph-common-16.0.0-316.gcbb84 884 kB/s | 62 kB 00:00 2020-04-02T23:44:17.552 INFO:teuthology.orchestra.run.smithi082.stdout:(19/125): python3-cephfs-16.0.0-316.gcbb84f7.el 2.1 MB/s | 162 kB 00:00 2020-04-02T23:44:17.636 INFO:teuthology.orchestra.run.smithi082.stdout:(20/125): python3-rados-16.0.0-316.gcbb84f7.el8 4.1 MB/s | 352 kB 00:00 2020-04-02T23:44:17.702 INFO:teuthology.orchestra.run.smithi082.stdout:(21/125): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 8.6 MB/s | 3.2 MB 00:00 2020-04-02T23:44:17.717 INFO:teuthology.orchestra.run.smithi082.stdout:(22/125): python3-rbd-16.0.0-316.gcbb84f7.el8.x 3.9 MB/s | 331 kB 00:00 2020-04-02T23:44:17.767 INFO:teuthology.orchestra.run.smithi082.stdout:(23/125): python3-rgw-16.0.0-316.gcbb84f7.el8.x 1.7 MB/s | 113 kB 00:00 2020-04-02T23:44:17.782 INFO:teuthology.orchestra.run.smithi082.stdout:(24/125): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 1.3 MB/s | 72 kB 00:00 2020-04-02T23:44:17.852 INFO:teuthology.orchestra.run.smithi082.stdout:(25/125): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 1.8 MB/s | 141 kB 00:00 2020-04-02T23:44:17.927 INFO:teuthology.orchestra.run.smithi082.stdout:(26/125): ceph-grafana-dashboards-16.0.0-316.gc 298 kB/s | 22 kB 00:00 2020-04-02T23:44:18.005 INFO:teuthology.orchestra.run.smithi082.stdout:(27/125): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 516 kB/s | 40 kB 00:00 2020-04-02T23:44:18.155 INFO:teuthology.orchestra.run.smithi082.stdout:(28/125): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 6.9 MB/s | 2.7 MB 00:00 2020-04-02T23:44:18.585 INFO:teuthology.orchestra.run.smithi082.stdout:(29/125): ceph-mgr-dashboard-16.0.0-316.gcbb84f 5.7 MB/s | 3.3 MB 00:00 2020-04-02T23:44:18.657 INFO:teuthology.orchestra.run.smithi082.stdout:(30/125): ceph-mgr-modules-core-16.0.0-316.gcbb 2.2 MB/s | 161 kB 00:00 2020-04-02T23:44:18.723 INFO:teuthology.orchestra.run.smithi082.stdout:(31/125): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 408 kB/s | 27 kB 00:00 2020-04-02T23:44:18.790 INFO:teuthology.orchestra.run.smithi082.stdout:(32/125): ceph-prometheus-alerts-16.0.0-316.gcb 131 kB/s | 8.7 kB 00:00 2020-04-02T23:44:18.862 INFO:teuthology.orchestra.run.smithi082.stdout:(33/125): automake-1.16.1-6.el8.noarch.rpm 9.7 MB/s | 713 kB 00:00 2020-04-02T23:44:18.898 INFO:teuthology.orchestra.run.smithi082.stdout:(34/125): bison-3.0.4-10.el8.x86_64.rpm 19 MB/s | 688 kB 00:00 2020-04-02T23:44:18.926 INFO:teuthology.orchestra.run.smithi082.stdout:(35/125): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2020-04-02T23:44:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:(36/125): jq-1.5-12.el8.x86_64.rpm 6.5 MB/s | 161 kB 00:00 2020-04-02T23:44:18.978 INFO:teuthology.orchestra.run.smithi082.stdout:(37/125): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2020-04-02T23:44:19.009 INFO:teuthology.orchestra.run.smithi082.stdout:(38/125): libtool-2.4.6-25.el8.x86_64.rpm 22 MB/s | 709 kB 00:00 2020-04-02T23:44:19.029 INFO:teuthology.orchestra.run.smithi082.stdout:(39/125): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2020-04-02T23:44:19.073 INFO:teuthology.orchestra.run.smithi082.stdout:(40/125): oniguruma-6.8.2-1.el8.x86_64.rpm 4.2 MB/s | 188 kB 00:00 2020-04-02T23:44:19.120 INFO:teuthology.orchestra.run.smithi082.stdout:(41/125): ceph-mgr-diskprediction-local-16.0.0- 8.9 MB/s | 8.6 MB 00:00 2020-04-02T23:44:19.189 INFO:teuthology.orchestra.run.smithi082.stdout:(42/125): openblas-0.3.3-2.el8.x86_64.rpm 37 MB/s | 4.3 MB 00:00 2020-04-02T23:44:19.205 INFO:teuthology.orchestra.run.smithi082.stdout:(43/125): python3-html5lib-0.999999999-6.el8.no 13 MB/s | 214 kB 00:00 2020-04-02T23:44:19.215 INFO:teuthology.orchestra.run.smithi082.stdout:(44/125): python3-jsonpatch-1.21-2.el8.noarch.r 2.8 MB/s | 27 kB 00:00 2020-04-02T23:44:19.227 INFO:teuthology.orchestra.run.smithi082.stdout:(45/125): python3-jsonpointer-1.10-11.el8.noarc 1.5 MB/s | 20 kB 00:00 2020-04-02T23:44:19.289 INFO:teuthology.orchestra.run.smithi082.stdout:(46/125): openblas-threads-0.3.3-2.el8.x86_64.r 28 MB/s | 4.4 MB 00:00 2020-04-02T23:44:19.289 INFO:teuthology.orchestra.run.smithi082.stdout:(47/125): python3-lxml-4.2.3-1.el8.x86_64.rpm 26 MB/s | 1.5 MB 00:00 2020-04-02T23:44:19.294 INFO:teuthology.orchestra.run.smithi082.stdout:(48/125): python3-mako-1.0.6-13.el8.noarch.rpm 10 MB/s | 157 kB 00:00 2020-04-02T23:44:19.335 INFO:teuthology.orchestra.run.smithi082.stdout:(49/125): python3-markupsafe-0.23-19.el8.x86_64 792 kB/s | 39 kB 00:00 2020-04-02T23:44:19.360 INFO:teuthology.orchestra.run.smithi082.stdout:(50/125): python3-numpy-f2py-1.14.3-9.el8.x86_6 9.0 MB/s | 225 kB 00:00 2020-04-02T23:44:19.381 INFO:teuthology.orchestra.run.smithi082.stdout:(51/125): python3-numpy-1.14.3-9.el8.x86_64.rpm 43 MB/s | 3.7 MB 00:00 2020-04-02T23:44:19.381 INFO:teuthology.orchestra.run.smithi082.stdout:(52/125): python3-prettytable-0.7.2-14.el8.noar 2.0 MB/s | 44 kB 00:00 2020-04-02T23:44:19.401 INFO:teuthology.orchestra.run.smithi082.stdout:(53/125): python3-pyasn1-modules-0.3.7-6.el8.no 5.4 MB/s | 110 kB 00:00 2020-04-02T23:44:19.407 INFO:teuthology.orchestra.run.smithi082.stdout:(54/125): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.7 MB/s | 126 kB 00:00 2020-04-02T23:44:19.440 INFO:teuthology.orchestra.run.smithi082.stdout:(55/125): python3-pytz-2017.2-9.el8.noarch.rpm 1.4 MB/s | 54 kB 00:00 2020-04-02T23:44:19.453 INFO:teuthology.orchestra.run.smithi082.stdout:(56/125): python3-webencodings-0.5.1-6.el8.noar 1.9 MB/s | 27 kB 00:00 2020-04-02T23:44:19.492 INFO:teuthology.orchestra.run.smithi082.stdout:(57/125): python3-werkzeug-0.12.2-4.el8.noarch. 12 MB/s | 457 kB 00:00 2020-04-02T23:44:19.536 INFO:teuthology.orchestra.run.smithi082.stdout:(58/125): socat-1.7.3.2-6.el8.x86_64.rpm 6.7 MB/s | 298 kB 00:00 2020-04-02T23:44:19.551 INFO:teuthology.orchestra.run.smithi082.stdout:(59/125): elfutils-libelf-devel-0.176-5.el8.x86 3.5 MB/s | 54 kB 00:00 2020-04-02T23:44:19.569 INFO:teuthology.orchestra.run.smithi082.stdout:(60/125): fuse-2.9.7-12.el8.x86_64.rpm 4.5 MB/s | 82 kB 00:00 2020-04-02T23:44:19.583 INFO:teuthology.orchestra.run.smithi082.stdout:(61/125): fuse-common-3.2.1-12.el8.x86_64.rpm 1.5 MB/s | 21 kB 00:00 2020-04-02T23:44:19.598 INFO:teuthology.orchestra.run.smithi082.stdout:(62/125): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.2 MB/s | 48 kB 00:00 2020-04-02T23:44:19.673 INFO:teuthology.orchestra.run.smithi050.stdout:(7/125): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_6 7.2 MB/s | 17 MB 00:02 2020-04-02T23:44:19.710 INFO:teuthology.orchestra.run.smithi082.stdout:(63/125): python3-scipy-1.0.0-20.module_el8.1.0 48 MB/s | 15 MB 00:00 2020-04-02T23:44:19.712 INFO:teuthology.orchestra.run.smithi082.stdout:(64/125): krb5-devel-1.17-9.el8.x86_64.rpm 4.7 MB/s | 548 kB 00:00 2020-04-02T23:44:19.717 INFO:teuthology.orchestra.run.smithi082.stdout:(65/125): libaio-devel-0.3.112-1.el8.x86_64.rpm 2.5 MB/s | 19 kB 00:00 2020-04-02T23:44:19.729 INFO:teuthology.orchestra.run.smithi082.stdout:(66/125): libcom_err-devel-1.44.6-3.el8.x86_64. 2.2 MB/s | 38 kB 00:00 2020-04-02T23:44:19.740 INFO:teuthology.orchestra.run.smithi082.stdout:(67/125): libgfortran-8.3.1-4.5.el8.x86_64.rpm 28 MB/s | 638 kB 00:00 2020-04-02T23:44:19.741 INFO:teuthology.orchestra.run.smithi082.stdout:(68/125): libquadmath-8.3.1-4.5.el8.x86_64.rpm 14 MB/s | 169 kB 00:00 2020-04-02T23:44:19.750 INFO:teuthology.orchestra.run.smithi082.stdout:(69/125): librabbitmq-0.9.0-1.el8.x86_64.rpm 4.4 MB/s | 47 kB 00:00 2020-04-02T23:44:19.758 INFO:teuthology.orchestra.run.smithi082.stdout:(70/125): libselinux-devel-2.9-2.1.el8.x86_64.r 12 MB/s | 199 kB 00:00 2020-04-02T23:44:19.763 INFO:teuthology.orchestra.run.smithi082.stdout:(71/125): libsepol-devel-2.9-1.el8.x86_64.rpm 6.9 MB/s | 86 kB 00:00 2020-04-02T23:44:19.769 INFO:teuthology.orchestra.run.smithi082.stdout:(72/125): libuuid-devel-2.32.1-17.el8.x86_64.rp 7.9 MB/s | 95 kB 00:00 2020-04-02T23:44:19.772 INFO:teuthology.orchestra.run.smithi082.stdout:(73/125): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.9 MB/s | 18 kB 00:00 2020-04-02T23:44:19.783 INFO:teuthology.orchestra.run.smithi082.stdout:(74/125): libxslt-1.1.32-3.el8.x86_64.rpm 18 MB/s | 249 kB 00:00 2020-04-02T23:44:19.824 INFO:teuthology.orchestra.run.smithi082.stdout:(75/125): openssl-devel-1.1.1c-2.el8.x86_64.rpm 44 MB/s | 2.3 MB 00:00 2020-04-02T23:44:19.830 INFO:teuthology.orchestra.run.smithi082.stdout:(76/125): pcre2-devel-10.32-1.el8.x86_64.rpm 13 MB/s | 605 kB 00:00 2020-04-02T23:44:19.839 INFO:teuthology.orchestra.run.smithi082.stdout:(77/125): pcre2-utf32-10.32-1.el8.x86_64.rpm 23 MB/s | 220 kB 00:00 2020-04-02T23:44:19.841 INFO:teuthology.orchestra.run.smithi082.stdout:(78/125): pcre2-utf16-10.32-1.el8.x86_64.rpm 14 MB/s | 228 kB 00:00 2020-04-02T23:44:19.850 INFO:teuthology.orchestra.run.smithi082.stdout:(79/125): python3-jwt-1.6.1-2.el8.noarch.rpm 4.8 MB/s | 43 kB 00:00 2020-04-02T23:44:19.854 INFO:teuthology.orchestra.run.smithi082.stdout:(80/125): python3-chardet-3.0.4-7.el8.noarch.rp 13 MB/s | 195 kB 00:00 2020-04-02T23:44:19.861 INFO:teuthology.orchestra.run.smithi082.stdout:(81/125): python3-pysocks-1.6.8-3.el8.noarch.rp 5.1 MB/s | 34 kB 00:00 2020-04-02T23:44:19.864 INFO:teuthology.orchestra.run.smithi082.stdout:(82/125): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2020-04-02T23:44:19.874 INFO:teuthology.orchestra.run.smithi082.stdout:(83/125): python3-requests-oauthlib-1.0.0-1.el8 4.4 MB/s | 43 kB 00:00 2020-04-02T23:44:19.875 INFO:teuthology.orchestra.run.smithi082.stdout:(84/125): python3-requests-2.20.0-2.1.el8_1.noa 8.5 MB/s | 123 kB 00:00 2020-04-02T23:44:19.881 INFO:teuthology.orchestra.run.smithi082.stdout:(85/125): python3-urllib3-1.24.2-2.el8.noarch.r 24 MB/s | 176 kB 00:00 2020-04-02T23:44:19.886 INFO:teuthology.orchestra.run.smithi082.stdout:(86/125): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 6.3 MB/s | 69 kB 00:00 2020-04-02T23:44:19.891 INFO:teuthology.orchestra.run.smithi082.stdout:(87/125): zlib-devel-1.2.11-10.el8.x86_64.rpm 5.7 MB/s | 56 kB 00:00 2020-04-02T23:44:19.947 INFO:teuthology.orchestra.run.smithi082.stdout:(88/125): python3-cheroot-8.2.1-1.el8.noarch.rp 2.3 MB/s | 145 kB 00:00 2020-04-02T23:44:19.959 INFO:teuthology.orchestra.run.smithi082.stdout:(89/125): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 385 kB 00:00 2020-04-02T23:44:19.967 INFO:teuthology.orchestra.run.smithi082.stdout:(90/125): python3-execnet-1.7.1-1.el8.2.noarch. 17 MB/s | 356 kB 00:00 2020-04-02T23:44:19.968 INFO:teuthology.orchestra.run.smithi082.stdout:(91/125): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2020-04-02T23:44:19.976 INFO:teuthology.orchestra.run.smithi082.stdout:(92/125): python3-jaraco-functools-2.0-4.el8.no 2.0 MB/s | 18 kB 00:00 2020-04-02T23:44:19.977 INFO:teuthology.orchestra.run.smithi082.stdout:(93/125): python3-logutils-0.3.5-11.el8.noarch. 5.5 MB/s | 49 kB 00:00 2020-04-02T23:44:19.985 INFO:teuthology.orchestra.run.smithi082.stdout:(94/125): python3-more-itertools-7.2.0-4.el8.no 6.9 MB/s | 59 kB 00:00 2020-04-02T23:44:19.990 INFO:teuthology.orchestra.run.smithi082.stdout:(95/125): python3-pecan-1.3.2-9.el8.noarch.rpm 21 MB/s | 283 kB 00:00 2020-04-02T23:44:19.993 INFO:teuthology.orchestra.run.smithi082.stdout:(96/125): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-04-02T23:44:19.999 INFO:teuthology.orchestra.run.smithi082.stdout:(97/125): python3-remoto-1.1.4-4.el8.noarch.rpm 5.3 MB/s | 48 kB 00:00 2020-04-02T23:44:20.002 INFO:teuthology.orchestra.run.smithi082.stdout:(98/125): python3-repoze-lru-0.7-6.el8.noarch.r 3.9 MB/s | 34 kB 00:00 2020-04-02T23:44:20.010 INFO:teuthology.orchestra.run.smithi082.stdout:(99/125): python3-routes-2.4.1-12.el8.noarch.rp 17 MB/s | 197 kB 00:00 2020-04-02T23:44:20.012 INFO:teuthology.orchestra.run.smithi082.stdout:(100/125): python3-simplegeneric-0.8.1-17.el8.n 1.9 MB/s | 19 kB 00:00 2020-04-02T23:44:20.019 INFO:teuthology.orchestra.run.smithi082.stdout:(101/125): python3-singledispatch-3.4.0.3-18.el 2.9 MB/s | 24 kB 00:00 2020-04-02T23:44:20.020 INFO:teuthology.orchestra.run.smithi082.stdout:(102/125): python3-tempora-1.14.1-5.el8.noarch. 3.5 MB/s | 30 kB 00:00 2020-04-02T23:44:20.027 INFO:teuthology.orchestra.run.smithi082.stdout:(103/125): python3-trustme-0.5.2-4.el8.noarch.r 3.3 MB/s | 27 kB 00:00 2020-04-02T23:44:20.028 INFO:teuthology.orchestra.run.smithi082.stdout:(104/125): python3-zc-lockfile-2.0-2.el8.noarch 2.7 MB/s | 23 kB 00:00 2020-04-02T23:44:20.090 INFO:teuthology.orchestra.run.smithi082.stdout:(105/125): liboath-2.6.2-3.el8.x86_64.rpm 961 kB/s | 59 kB 00:00 2020-04-02T23:44:20.121 INFO:teuthology.orchestra.run.smithi082.stdout:(106/125): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-02T23:44:20.121 INFO:teuthology.orchestra.run.smithi082.stdout:(107/125): libunwind-1.3.1-3.el8.x86_64.rpm 2.3 MB/s | 75 kB 00:00 2020-04-02T23:44:20.137 INFO:teuthology.orchestra.run.smithi082.stdout:(108/125): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-04-02T23:44:20.137 INFO:teuthology.orchestra.run.smithi082.stdout:(109/125): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-04-02T23:44:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:(110/125): python3-cachetools-3.1.1-4.el8.noarc 2.1 MB/s | 33 kB 00:00 2020-04-02T23:44:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:(111/125): python3-beautifulsoup4-4.6.3-2.el8.1 11 MB/s | 185 kB 00:00 2020-04-02T23:44:20.169 INFO:teuthology.orchestra.run.smithi082.stdout:(112/125): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-04-02T23:44:20.170 INFO:teuthology.orchestra.run.smithi082.stdout:(113/125): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-04-02T23:44:20.185 INFO:teuthology.orchestra.run.smithi082.stdout:(114/125): python3-google-auth-1.1.1-10.el8.noa 4.9 MB/s | 81 kB 00:00 2020-04-02T23:44:20.201 INFO:teuthology.orchestra.run.smithi082.stdout:(115/125): python3-rsa-3.4.2-12.el8.noarch.rpm 4.4 MB/s | 73 kB 00:00 2020-04-02T23:44:20.234 INFO:teuthology.orchestra.run.smithi082.stdout:(116/125): python3-kubernetes-10.0.1-2.el8.noar 18 MB/s | 1.1 MB 00:00 2020-04-02T23:44:20.235 INFO:teuthology.orchestra.run.smithi082.stdout:(117/125): python3-waitress-1.2.1-2.el8.1.noarc 7.1 MB/s | 241 kB 00:00 2020-04-02T23:44:20.251 INFO:teuthology.orchestra.run.smithi082.stdout:(118/125): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-04-02T23:44:20.251 INFO:teuthology.orchestra.run.smithi082.stdout:(119/125): python3-websocket-client-0.56.0-5.el 3.6 MB/s | 61 kB 00:00 2020-04-02T23:44:20.267 INFO:teuthology.orchestra.run.smithi082.stdout:(120/125): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-04-02T23:44:20.268 INFO:teuthology.orchestra.run.smithi082.stdout:(121/125): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.1 MB/s | 69 kB 00:00 2020-04-02T23:44:20.272 INFO:teuthology.orchestra.run.smithi082.stdout:(122/125): leveldb-1.21-2.el8.x86_64.rpm 40 MB/s | 179 kB 00:00 2020-04-02T23:44:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:(8/125): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_6 1.3 MB/s | 4.4 MB 00:03 2020-04-02T23:44:20.496 INFO:teuthology.orchestra.run.smithi050.stdout:(9/125): ceph-selinux-16.0.0-316.gcbb84f7.el8.x 435 kB/s | 25 kB 00:00 2020-04-02T23:44:20.655 INFO:teuthology.orchestra.run.smithi050.stdout:(10/125): ceph-radosgw-16.0.0-316.gcbb84f7.el8. 10 MB/s | 9.8 MB 00:00 2020-04-02T23:44:20.725 INFO:teuthology.orchestra.run.smithi050.stdout:(11/125): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 565 kB/s | 39 kB 00:00 2020-04-02T23:44:20.767 INFO:teuthology.orchestra.run.smithi082.stdout:(123/125): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 3.9 MB/s | 1.9 MB 00:00 2020-04-02T23:44:20.792 INFO:teuthology.orchestra.run.smithi050.stdout:(12/125): libcephfs-devel-16.0.0-316.gcbb84f7.e 319 kB/s | 21 kB 00:00 2020-04-02T23:44:20.845 INFO:teuthology.orchestra.run.smithi050.stdout:(13/125): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 9.4 MB/s | 508 kB 00:00 2020-04-02T23:44:20.883 INFO:teuthology.orchestra.run.smithi050.stdout:(14/125): librados-devel-16.0.0-316.gcbb84f7.el 3.6 MB/s | 141 kB 00:00 2020-04-02T23:44:20.924 INFO:teuthology.orchestra.run.smithi050.stdout:(15/125): libradosstriper1-16.0.0-316.gcbb84f7. 9.0 MB/s | 377 kB 00:00 2020-04-02T23:44:21.123 INFO:teuthology.orchestra.run.smithi082.stdout:(124/125): ceph-test-16.0.0-316.gcbb84f7.el8.x8 9.9 MB/s | 42 MB 00:04 2020-04-02T23:44:21.135 INFO:teuthology.orchestra.run.smithi082.stdout:(125/125): librados2-16.0.0-316.gcbb84f7.el8.x8 4.1 MB/s | 3.6 MB 00:00 2020-04-02T23:44:21.139 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:44:21.141 INFO:teuthology.orchestra.run.smithi082.stdout:Total 25 MB/s | 174 MB 00:06 2020-04-02T23:44:21.153 INFO:teuthology.orchestra.run.smithi050.stdout:(16/125): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 14 MB/s | 3.2 MB 00:00 2020-04-02T23:44:21.192 INFO:teuthology.orchestra.run.smithi050.stdout:(17/125): python3-ceph-argparse-16.0.0-316.gcbb 1.0 MB/s | 40 kB 00:00 2020-04-02T23:44:21.209 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2020-04-02T23:44:21.229 INFO:teuthology.orchestra.run.smithi050.stdout:(18/125): python3-ceph-common-16.0.0-316.gcbb84 1.6 MB/s | 62 kB 00:00 2020-04-02T23:44:21.268 INFO:teuthology.orchestra.run.smithi050.stdout:(19/125): python3-cephfs-16.0.0-316.gcbb84f7.el 4.1 MB/s | 162 kB 00:00 2020-04-02T23:44:21.309 INFO:teuthology.orchestra.run.smithi050.stdout:(20/125): python3-rados-16.0.0-316.gcbb84f7.el8 8.5 MB/s | 352 kB 00:00 2020-04-02T23:44:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2020-04-02T23:44:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2020-04-02T23:44:21.349 INFO:teuthology.orchestra.run.smithi050.stdout:(21/125): python3-rbd-16.0.0-316.gcbb84f7.el8.x 8.0 MB/s | 331 kB 00:00 2020-04-02T23:44:21.387 INFO:teuthology.orchestra.run.smithi050.stdout:(22/125): python3-rgw-16.0.0-316.gcbb84f7.el8.x 2.9 MB/s | 113 kB 00:00 2020-04-02T23:44:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:(23/125): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 1.9 MB/s | 72 kB 00:00 2020-04-02T23:44:21.618 INFO:teuthology.orchestra.run.smithi050.stdout:(24/125): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 14 MB/s | 2.7 MB 00:00 2020-04-02T23:44:21.656 INFO:teuthology.orchestra.run.smithi050.stdout:(25/125): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 3.6 MB/s | 141 kB 00:00 2020-04-02T23:44:21.693 INFO:teuthology.orchestra.run.smithi050.stdout:(26/125): ceph-grafana-dashboards-16.0.0-316.gc 613 kB/s | 22 kB 00:00 2020-04-02T23:44:21.730 INFO:teuthology.orchestra.run.smithi050.stdout:(27/125): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 1.0 MB/s | 40 kB 00:00 2020-04-02T23:44:21.964 INFO:teuthology.orchestra.run.smithi050.stdout:(28/125): ceph-mgr-dashboard-16.0.0-316.gcbb84f 14 MB/s | 3.3 MB 00:00 2020-04-02T23:44:22.529 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2020-04-02T23:44:22.530 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2020-04-02T23:44:22.542 INFO:teuthology.orchestra.run.smithi050.stdout:(29/125): ceph-mgr-diskprediction-local-16.0.0- 15 MB/s | 8.6 MB 00:00 2020-04-02T23:44:22.582 INFO:teuthology.orchestra.run.smithi050.stdout:(30/125): ceph-mgr-modules-core-16.0.0-316.gcbb 4.0 MB/s | 161 kB 00:00 2020-04-02T23:44:22.619 INFO:teuthology.orchestra.run.smithi050.stdout:(31/125): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 730 kB/s | 27 kB 00:00 2020-04-02T23:44:22.657 INFO:teuthology.orchestra.run.smithi050.stdout:(32/125): ceph-prometheus-alerts-16.0.0-316.gcb 239 kB/s | 8.7 kB 00:00 2020-04-02T23:44:22.698 INFO:teuthology.orchestra.run.smithi050.stdout:(33/125): automake-1.16.1-6.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2020-04-02T23:44:22.710 INFO:teuthology.orchestra.run.smithi050.stdout:(34/125): bison-3.0.4-10.el8.x86_64.rpm 55 MB/s | 688 kB 00:00 2020-04-02T23:44:22.715 INFO:teuthology.orchestra.run.smithi050.stdout:(35/125): flex-2.6.1-9.el8.x86_64.rpm 66 MB/s | 320 kB 00:00 2020-04-02T23:44:22.718 INFO:teuthology.orchestra.run.smithi050.stdout:(36/125): jq-1.5-12.el8.x86_64.rpm 58 MB/s | 161 kB 00:00 2020-04-02T23:44:22.723 INFO:teuthology.orchestra.run.smithi050.stdout:(37/125): librdkafka-0.11.4-1.el8.x86_64.rpm 70 MB/s | 353 kB 00:00 2020-04-02T23:44:22.732 INFO:teuthology.orchestra.run.smithi050.stdout:(38/125): libtool-2.4.6-25.el8.x86_64.rpm 77 MB/s | 709 kB 00:00 2020-04-02T23:44:22.736 INFO:teuthology.orchestra.run.smithi050.stdout:(39/125): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-04-02T23:44:22.740 INFO:teuthology.orchestra.run.smithi050.stdout:(40/125): oniguruma-6.8.2-1.el8.x86_64.rpm 61 MB/s | 188 kB 00:00 2020-04-02T23:44:22.791 INFO:teuthology.orchestra.run.smithi050.stdout:(41/125): openblas-0.3.3-2.el8.x86_64.rpm 84 MB/s | 4.3 MB 00:00 2020-04-02T23:44:22.844 INFO:teuthology.orchestra.run.smithi050.stdout:(42/125): openblas-threads-0.3.3-2.el8.x86_64.r 83 MB/s | 4.4 MB 00:00 2020-04-02T23:44:22.848 INFO:teuthology.orchestra.run.smithi050.stdout:(43/125): python3-html5lib-0.999999999-6.el8.no 59 MB/s | 214 kB 00:00 2020-04-02T23:44:22.849 INFO:teuthology.orchestra.run.smithi050.stdout:(44/125): python3-jsonpatch-1.21-2.el8.noarch.r 24 MB/s | 27 kB 00:00 2020-04-02T23:44:22.850 INFO:teuthology.orchestra.run.smithi050.stdout:(45/125): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-04-02T23:44:22.869 INFO:teuthology.orchestra.run.smithi050.stdout:(46/125): python3-lxml-4.2.3-1.el8.x86_64.rpm 80 MB/s | 1.5 MB 00:00 2020-04-02T23:44:22.872 INFO:teuthology.orchestra.run.smithi050.stdout:(47/125): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2020-04-02T23:44:22.873 INFO:teuthology.orchestra.run.smithi050.stdout:(48/125): python3-markupsafe-0.23-19.el8.x86_64 29 MB/s | 39 kB 00:00 2020-04-02T23:44:22.918 INFO:teuthology.orchestra.run.smithi050.stdout:(49/125): python3-numpy-1.14.3-9.el8.x86_64.rpm 84 MB/s | 3.7 MB 00:00 2020-04-02T23:44:22.922 INFO:teuthology.orchestra.run.smithi050.stdout:(50/125): python3-numpy-f2py-1.14.3-9.el8.x86_6 61 MB/s | 225 kB 00:00 2020-04-02T23:44:22.924 INFO:teuthology.orchestra.run.smithi050.stdout:(51/125): python3-prettytable-0.7.2-14.el8.noar 33 MB/s | 44 kB 00:00 2020-04-02T23:44:22.926 INFO:teuthology.orchestra.run.smithi050.stdout:(52/125): python3-pyasn1-0.3.7-6.el8.noarch.rpm 53 MB/s | 126 kB 00:00 2020-04-02T23:44:22.928 INFO:teuthology.orchestra.run.smithi050.stdout:(53/125): python3-pyasn1-modules-0.3.7-6.el8.no 52 MB/s | 110 kB 00:00 2020-04-02T23:44:22.930 INFO:teuthology.orchestra.run.smithi050.stdout:(54/125): python3-pytz-2017.2-9.el8.noarch.rpm 35 MB/s | 54 kB 00:00 2020-04-02T23:44:23.209 INFO:teuthology.orchestra.run.smithi050.stdout:(55/125): python3-scipy-1.0.0-20.module_el8.1.0 52 MB/s | 15 MB 00:00 2020-04-02T23:44:23.210 INFO:teuthology.orchestra.run.smithi050.stdout:(56/125): python3-webencodings-0.5.1-6.el8.noar 18 MB/s | 27 kB 00:00 2020-04-02T23:44:23.216 INFO:teuthology.orchestra.run.smithi050.stdout:(57/125): python3-werkzeug-0.12.2-4.el8.noarch. 74 MB/s | 457 kB 00:00 2020-04-02T23:44:23.221 INFO:teuthology.orchestra.run.smithi050.stdout:(58/125): socat-1.7.3.2-6.el8.x86_64.rpm 69 MB/s | 298 kB 00:00 2020-04-02T23:44:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:(59/125): elfutils-libelf-devel-0.176-5.el8.x86 34 MB/s | 54 kB 00:00 2020-04-02T23:44:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:(60/125): fuse-2.9.7-12.el8.x86_64.rpm 42 MB/s | 82 kB 00:00 2020-04-02T23:44:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:(61/125): fuse-common-3.2.1-12.el8.x86_64.rpm 15 MB/s | 21 kB 00:00 2020-04-02T23:44:23.228 INFO:teuthology.orchestra.run.smithi050.stdout:(62/125): keyutils-libs-devel-1.5.10-6.el8.x86_ 32 MB/s | 48 kB 00:00 2020-04-02T23:44:23.235 INFO:teuthology.orchestra.run.smithi050.stdout:(63/125): krb5-devel-1.17-9.el8.x86_64.rpm 74 MB/s | 548 kB 00:00 2020-04-02T23:44:23.237 INFO:teuthology.orchestra.run.smithi050.stdout:(64/125): libaio-devel-0.3.112-1.el8.x86_64.rpm 14 MB/s | 19 kB 00:00 2020-04-02T23:44:23.238 INFO:teuthology.orchestra.run.smithi050.stdout:(65/125): libcom_err-devel-1.44.6-3.el8.x86_64. 26 MB/s | 38 kB 00:00 2020-04-02T23:44:23.247 INFO:teuthology.orchestra.run.smithi050.stdout:(66/125): libgfortran-8.3.1-4.5.el8.x86_64.rpm 75 MB/s | 638 kB 00:00 2020-04-02T23:44:23.250 INFO:teuthology.orchestra.run.smithi050.stdout:(67/125): libquadmath-8.3.1-4.5.el8.x86_64.rpm 59 MB/s | 169 kB 00:00 2020-04-02T23:44:23.251 INFO:teuthology.orchestra.run.smithi050.stdout:(68/125): librabbitmq-0.9.0-1.el8.x86_64.rpm 29 MB/s | 47 kB 00:00 2020-04-02T23:44:23.255 INFO:teuthology.orchestra.run.smithi050.stdout:(69/125): libselinux-devel-2.9-2.1.el8.x86_64.r 61 MB/s | 199 kB 00:00 2020-04-02T23:44:23.257 INFO:teuthology.orchestra.run.smithi050.stdout:(70/125): libsepol-devel-2.9-1.el8.x86_64.rpm 48 MB/s | 86 kB 00:00 2020-04-02T23:44:23.259 INFO:teuthology.orchestra.run.smithi050.stdout:(71/125): libuuid-devel-2.32.1-17.el8.x86_64.rp 46 MB/s | 95 kB 00:00 2020-04-02T23:44:23.260 INFO:teuthology.orchestra.run.smithi050.stdout:(72/125): libverto-devel-0.3.0-5.el8.x86_64.rpm 13 MB/s | 18 kB 00:00 2020-04-02T23:44:23.265 INFO:teuthology.orchestra.run.smithi050.stdout:(73/125): libxslt-1.1.32-3.el8.x86_64.rpm 58 MB/s | 249 kB 00:00 2020-04-02T23:44:23.293 INFO:teuthology.orchestra.run.smithi050.stdout:(74/125): openssl-devel-1.1.1c-2.el8.x86_64.rpm 82 MB/s | 2.3 MB 00:00 2020-04-02T23:44:23.301 INFO:teuthology.orchestra.run.smithi050.stdout:(75/125): pcre2-devel-10.32-1.el8.x86_64.rpm 75 MB/s | 605 kB 00:00 2020-04-02T23:44:23.304 INFO:teuthology.orchestra.run.smithi050.stdout:(76/125): pcre2-utf16-10.32-1.el8.x86_64.rpm 65 MB/s | 228 kB 00:00 2020-04-02T23:44:23.308 INFO:teuthology.orchestra.run.smithi050.stdout:(77/125): pcre2-utf32-10.32-1.el8.x86_64.rpm 67 MB/s | 220 kB 00:00 2020-04-02T23:44:23.311 INFO:teuthology.orchestra.run.smithi050.stdout:(78/125): python3-chardet-3.0.4-7.el8.noarch.rp 62 MB/s | 195 kB 00:00 2020-04-02T23:44:23.312 INFO:teuthology.orchestra.run.smithi050.stdout:(79/125): python3-jwt-1.6.1-2.el8.noarch.rpm 30 MB/s | 43 kB 00:00 2020-04-02T23:44:23.315 INFO:teuthology.orchestra.run.smithi050.stdout:(80/125): python3-oauthlib-2.1.0-1.el8.noarch.r 60 MB/s | 155 kB 00:00 2020-04-02T23:44:23.316 INFO:teuthology.orchestra.run.smithi050.stdout:(81/125): python3-pysocks-1.6.8-3.el8.noarch.rp 28 MB/s | 34 kB 00:00 2020-04-02T23:44:23.319 INFO:teuthology.orchestra.run.smithi050.stdout:(82/125): python3-requests-2.20.0-2.1.el8_1.noa 57 MB/s | 123 kB 00:00 2020-04-02T23:44:23.320 INFO:teuthology.orchestra.run.smithi050.stdout:(83/125): python3-requests-oauthlib-1.0.0-1.el8 33 MB/s | 43 kB 00:00 2020-04-02T23:44:23.323 INFO:teuthology.orchestra.run.smithi050.stdout:(84/125): python3-urllib3-1.24.2-2.el8.noarch.r 62 MB/s | 176 kB 00:00 2020-04-02T23:44:23.325 INFO:teuthology.orchestra.run.smithi050.stdout:(85/125): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 40 MB/s | 69 kB 00:00 2020-04-02T23:44:23.327 INFO:teuthology.orchestra.run.smithi050.stdout:(86/125): zlib-devel-1.2.11-10.el8.x86_64.rpm 36 MB/s | 56 kB 00:00 2020-04-02T23:44:23.387 INFO:teuthology.orchestra.run.smithi050.stdout:(87/125): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-04-02T23:44:23.408 INFO:teuthology.orchestra.run.smithi050.stdout:(88/125): python3-cherrypy-18.4.0-1.el8.noarch. 18 MB/s | 385 kB 00:00 2020-04-02T23:44:23.421 INFO:teuthology.orchestra.run.smithi050.stdout:(89/125): python3-execnet-1.7.1-1.el8.2.noarch. 27 MB/s | 356 kB 00:00 2020-04-02T23:44:23.430 INFO:teuthology.orchestra.run.smithi050.stdout:(90/125): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-02T23:44:23.439 INFO:teuthology.orchestra.run.smithi050.stdout:(91/125): python3-jaraco-functools-2.0-4.el8.no 1.9 MB/s | 18 kB 00:00 2020-04-02T23:44:23.448 INFO:teuthology.orchestra.run.smithi050.stdout:(92/125): python3-logutils-0.3.5-11.el8.noarch. 5.6 MB/s | 49 kB 00:00 2020-04-02T23:44:23.460 INFO:teuthology.orchestra.run.smithi050.stdout:(93/125): python3-more-itertools-7.2.0-4.el8.no 4.7 MB/s | 59 kB 00:00 2020-04-02T23:44:23.472 INFO:teuthology.orchestra.run.smithi050.stdout:(94/125): python3-pecan-1.3.2-9.el8.noarch.rpm 23 MB/s | 283 kB 00:00 2020-04-02T23:44:23.480 INFO:teuthology.orchestra.run.smithi050.stdout:(95/125): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-04-02T23:44:23.489 INFO:teuthology.orchestra.run.smithi050.stdout:(96/125): python3-remoto-1.1.4-4.el8.noarch.rpm 5.6 MB/s | 48 kB 00:00 2020-04-02T23:44:23.499 INFO:teuthology.orchestra.run.smithi050.stdout:(97/125): python3-repoze-lru-0.7-6.el8.noarch.r 3.6 MB/s | 34 kB 00:00 2020-04-02T23:44:23.509 INFO:teuthology.orchestra.run.smithi050.stdout:(98/125): python3-routes-2.4.1-12.el8.noarch.rp 19 MB/s | 197 kB 00:00 2020-04-02T23:44:23.518 INFO:teuthology.orchestra.run.smithi050.stdout:(99/125): python3-simplegeneric-0.8.1-17.el8.no 2.2 MB/s | 19 kB 00:00 2020-04-02T23:44:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:(100/125): python3-singledispatch-3.4.0.3-18.el 2.9 MB/s | 24 kB 00:00 2020-04-02T23:44:23.535 INFO:teuthology.orchestra.run.smithi050.stdout:(101/125): python3-tempora-1.14.1-5.el8.noarch. 3.3 MB/s | 30 kB 00:00 2020-04-02T23:44:23.545 INFO:teuthology.orchestra.run.smithi050.stdout:(102/125): python3-trustme-0.5.2-4.el8.noarch.r 2.6 MB/s | 27 kB 00:00 2020-04-02T23:44:23.554 INFO:teuthology.orchestra.run.smithi050.stdout:(103/125): python3-zc-lockfile-2.0-2.el8.noarch 2.5 MB/s | 23 kB 00:00 2020-04-02T23:44:23.692 INFO:teuthology.orchestra.run.smithi050.stdout:(104/125): ceph-common-16.0.0-316.gcbb84f7.el8. 2.3 MB/s | 21 MB 00:09 2020-04-02T23:44:23.949 INFO:teuthology.orchestra.run.smithi050.stdout:(105/125): liboath-2.6.2-3.el8.x86_64.rpm 229 kB/s | 59 kB 00:00 2020-04-02T23:44:23.980 INFO:teuthology.orchestra.run.smithi050.stdout:(106/125): libunwind-1.3.1-3.el8.x86_64.rpm 2.4 MB/s | 75 kB 00:00 2020-04-02T23:44:23.996 INFO:teuthology.orchestra.run.smithi050.stdout:(107/125): gperftools-libs-2.7-6.el8.x86_64.rpm 713 kB/s | 315 kB 00:00 2020-04-02T23:44:23.997 INFO:teuthology.orchestra.run.smithi050.stdout:(108/125): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-04-02T23:44:24.016 INFO:teuthology.orchestra.run.smithi050.stdout:(109/125): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.2 MB/s | 44 kB 00:00 2020-04-02T23:44:24.029 INFO:teuthology.orchestra.run.smithi050.stdout:(110/125): python3-beautifulsoup4-4.6.3-2.el8.1 5.7 MB/s | 185 kB 00:00 2020-04-02T23:44:24.035 INFO:teuthology.orchestra.run.smithi050.stdout:(111/125): python3-cachetools-3.1.1-4.el8.noarc 1.7 MB/s | 33 kB 00:00 2020-04-02T23:44:24.044 INFO:teuthology.orchestra.run.smithi050.stdout:(112/125): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-04-02T23:44:24.055 INFO:teuthology.orchestra.run.smithi050.stdout:(113/125): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-04-02T23:44:24.061 INFO:teuthology.orchestra.run.smithi050.stdout:(114/125): python3-google-auth-1.1.1-10.el8.noa 4.8 MB/s | 81 kB 00:00 2020-04-02T23:44:24.078 INFO:teuthology.orchestra.run.smithi050.stdout:(115/125): python3-rsa-3.4.2-12.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-04-02T23:44:24.096 INFO:teuthology.orchestra.run.smithi050.stdout:(116/125): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-04-02T23:44:24.114 INFO:teuthology.orchestra.run.smithi050.stdout:(117/125): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-04-02T23:44:24.133 INFO:teuthology.orchestra.run.smithi050.stdout:(118/125): python3-kubernetes-10.0.1-2.el8.noar 14 MB/s | 1.1 MB 00:00 2020-04-02T23:44:24.133 INFO:teuthology.orchestra.run.smithi050.stdout:(119/125): python3-websocket-client-0.56.0-5.el 3.1 MB/s | 61 kB 00:00 2020-04-02T23:44:24.150 INFO:teuthology.orchestra.run.smithi050.stdout:(120/125): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-04-02T23:44:24.153 INFO:teuthology.orchestra.run.smithi050.stdout:(121/125): python3-webtest-2.0.33-1.el8.noarch. 4.3 MB/s | 85 kB 00:00 2020-04-02T23:44:24.155 INFO:teuthology.orchestra.run.smithi050.stdout:(122/125): leveldb-1.21-2.el8.x86_64.rpm 32 MB/s | 179 kB 00:00 2020-04-02T23:44:24.569 INFO:teuthology.orchestra.run.smithi050.stdout:(123/125): librados2-16.0.0-316.gcbb84f7.el8.x8 8.6 MB/s | 3.6 MB 00:00 2020-04-02T23:44:24.648 INFO:teuthology.orchestra.run.smithi050.stdout:(124/125): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 3.9 MB/s | 1.9 MB 00:00 2020-04-02T23:44:27.059 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2020-04-02T23:44:27.314 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/127 2020-04-02T23:44:27.536 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/127 2020-04-02T23:44:27.751 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:44:28.144 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:44:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:44:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:44:28.784 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:44:28.892 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:44:29.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:44:29.159 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:44:29.351 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:44:29.534 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:44:29.877 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:44:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:44:30.174 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:44:30.378 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/127 2020-04-02T23:44:30.526 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:44:30.653 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:44:30.812 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/127 2020-04-02T23:44:30.905 INFO:teuthology.orchestra.run.smithi050.stdout:(125/125): ceph-test-16.0.0-316.gcbb84f7.el8.x8 4.0 MB/s | 42 MB 00:10 2020-04-02T23:44:30.910 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:44:30.910 INFO:teuthology.orchestra.run.smithi050.stdout:Total 11 MB/s | 174 MB 00:16 2020-04-02T23:44:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/127 2020-04-02T23:44:30.988 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2020-04-02T23:44:31.113 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2020-04-02T23:44:31.113 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2020-04-02T23:44:31.152 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/127 2020-04-02T23:44:31.375 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/127 2020-04-02T23:44:31.630 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/127 2020-04-02T23:44:31.802 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:44:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:44:32.184 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:44:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2020-04-02T23:44:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2020-04-02T23:44:32.719 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:44:32.883 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:44:33.453 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:44:33.619 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:44:34.307 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:44:34.626 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/127 2020-04-02T23:44:34.838 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/127 2020-04-02T23:44:34.970 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/127 2020-04-02T23:44:35.224 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:44:35.458 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:44:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2020-04-02T23:44:37.413 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:44:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/127 2020-04-02T23:44:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/127 2020-04-02T23:44:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/127 2020-04-02T23:44:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:44:37.894 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/127 2020-04-02T23:44:38.141 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/127 2020-04-02T23:44:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:44:38.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/127 2020-04-02T23:44:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:44:38.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/127 2020-04-02T23:44:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:44:38.814 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/127 2020-04-02T23:44:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:44:39.004 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/127 2020-04-02T23:44:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:44:39.168 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/127 2020-04-02T23:44:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:44:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:44:39.421 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/127 2020-04-02T23:44:39.467 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:44:39.618 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/127 2020-04-02T23:44:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:44:39.772 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/127 2020-04-02T23:44:39.956 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/127 2020-04-02T23:44:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:44:40.182 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/127 2020-04-02T23:44:40.249 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:44:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:44:40.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/127 2020-04-02T23:44:40.580 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/127 2020-04-02T23:44:40.611 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/127 2020-04-02T23:44:40.724 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:44:40.863 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:44:40.899 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/127 2020-04-02T23:44:41.078 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/127 2020-04-02T23:44:41.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/127 2020-04-02T23:44:41.213 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/127 2020-04-02T23:44:41.377 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/127 2020-04-02T23:44:41.395 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/127 2020-04-02T23:44:41.570 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/127 2020-04-02T23:44:41.626 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/127 2020-04-02T23:44:41.787 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/127 2020-04-02T23:44:41.873 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/127 2020-04-02T23:44:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/127 2020-04-02T23:44:42.040 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:44:42.140 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/127 2020-04-02T23:44:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:44:42.339 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/127 2020-04-02T23:44:42.390 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:44:42.511 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/127 2020-04-02T23:44:42.668 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/127 2020-04-02T23:44:42.884 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/127 2020-04-02T23:44:42.991 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:44:43.182 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:44:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/127 2020-04-02T23:44:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/127 2020-04-02T23:44:43.755 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:44:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/127 2020-04-02T23:44:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:44:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/127 2020-04-02T23:44:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/127 2020-04-02T23:44:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/127 2020-04-02T23:44:44.642 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:44:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/127 2020-04-02T23:44:45.007 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/127 2020-04-02T23:44:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/127 2020-04-02T23:44:45.211 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/127 2020-04-02T23:44:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/127 2020-04-02T23:44:45.610 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/127 2020-04-02T23:44:45.936 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:44:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:44:46.262 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/127 2020-04-02T23:44:46.542 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/127 2020-04-02T23:44:46.749 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/127 2020-04-02T23:44:47.020 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/127 2020-04-02T23:44:47.191 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/127 2020-04-02T23:44:47.337 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/127 2020-04-02T23:44:47.485 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/127 2020-04-02T23:44:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/127 2020-04-02T23:44:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/127 2020-04-02T23:44:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/127 2020-04-02T23:44:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:44:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/127 2020-04-02T23:44:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/127 2020-04-02T23:44:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/127 2020-04-02T23:44:48.558 INFO:teuthology.orchestra.run.smithi082.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:44:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:44:48.568 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/127 2020-04-02T23:44:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/127 2020-04-02T23:44:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/127 2020-04-02T23:44:49.183 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/127 2020-04-02T23:44:49.219 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/127 2020-04-02T23:44:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/127 2020-04-02T23:44:49.472 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/127 2020-04-02T23:44:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/127 2020-04-02T23:44:49.710 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/127 2020-04-02T23:44:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/127 2020-04-02T23:44:50.058 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/127 2020-04-02T23:44:50.196 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/127 2020-04-02T23:44:50.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/127 2020-04-02T23:44:50.389 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/127 2020-04-02T23:44:50.493 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/127 2020-04-02T23:44:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/127 2020-04-02T23:44:50.682 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/127 2020-04-02T23:44:50.876 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/127 2020-04-02T23:44:50.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/127 2020-04-02T23:44:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/127 2020-04-02T23:44:51.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/127 2020-04-02T23:44:51.216 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/127 2020-04-02T23:44:51.412 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/127 2020-04-02T23:44:51.452 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/127 2020-04-02T23:44:51.609 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/127 2020-04-02T23:44:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/127 2020-04-02T23:44:51.875 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/127 2020-04-02T23:44:51.976 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/127 2020-04-02T23:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/127 2020-04-02T23:44:52.274 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/127 2020-04-02T23:44:52.523 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/127 2020-04-02T23:44:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/127 2020-04-02T23:44:52.750 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/127 2020-04-02T23:44:52.779 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/127 2020-04-02T23:44:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/127 2020-04-02T23:44:53.007 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/127 2020-04-02T23:44:53.207 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/127 2020-04-02T23:44:53.213 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:44:53.279 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:44:53.348 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/127 2020-04-02T23:44:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/127 2020-04-02T23:44:53.595 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.5-12.el8.x86_64 92/127 2020-04-02T23:44:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/127 2020-04-02T23:44:53.899 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.1-6.el8.noarch 93/127 2020-04-02T23:44:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/127 2020-04-02T23:44:54.044 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/127 2020-04-02T23:44:54.101 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/127 2020-04-02T23:44:54.244 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/127 2020-04-02T23:44:54.303 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/127 2020-04-02T23:44:54.438 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/127 2020-04-02T23:44:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/127 2020-04-02T23:44:54.709 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/127 2020-04-02T23:44:54.887 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/127 2020-04-02T23:44:55.134 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/127 2020-04-02T23:44:55.372 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/127 2020-04-02T23:44:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/127 2020-04-02T23:44:55.904 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/127 2020-04-02T23:44:56.403 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/127 2020-04-02T23:44:56.641 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/127 2020-04-02T23:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/127 2020-04-02T23:44:58.037 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:44:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/127 2020-04-02T23:44:58.260 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/127 2020-04-02T23:44:58.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:44:58.569 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/127 2020-04-02T23:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/127 2020-04-02T23:44:58.960 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:44:59.054 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/127 2020-04-02T23:44:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/127 2020-04-02T23:44:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:44:59.360 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:44:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/127 2020-04-02T23:44:59.511 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:44:59.700 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/127 2020-04-02T23:44:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/127 2020-04-02T23:45:00.144 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/127 2020-04-02T23:45:00.389 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/127 2020-04-02T23:45:00.394 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/127 2020-04-02T23:45:00.394 INFO:teuthology.orchestra.run.smithi050.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:45:00.395 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:00.787 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/127 2020-04-02T23:45:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/127 2020-04-02T23:45:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/127 2020-04-02T23:45:01.490 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/127 2020-04-02T23:45:01.990 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/127 2020-04-02T23:45:02.302 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/127 2020-04-02T23:45:02.545 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/127 2020-04-02T23:45:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/127 2020-04-02T23:45:02.944 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/127 2020-04-02T23:45:03.229 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/127 2020-04-02T23:45:03.489 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/127 2020-04-02T23:45:03.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/127 2020-04-02T23:45:04.028 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/127 2020-04-02T23:45:04.557 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/127 2020-04-02T23:45:04.837 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/127 2020-04-02T23:45:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/127 2020-04-02T23:45:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/127 2020-04-02T23:45:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:45:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:45:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.5-12.el8.x86_64 92/127 2020-04-02T23:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.1-6.el8.noarch 93/127 2020-04-02T23:45:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/127 2020-04-02T23:45:06.579 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/127 2020-04-02T23:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/127 2020-04-02T23:45:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:45:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:45:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:45:11.786 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:45:11.869 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:45:12.634 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:45:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:45:15.757 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2020-04-02T23:45:15.757 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2020-04-02T23:45:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:16.466 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:45:16.863 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:45:17.099 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:45:18.511 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:45:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:45:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:45:20.094 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:45:20.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:45:20.447 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:45:21.286 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:45:22.131 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:45:23.169 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:45:23.347 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:45:23.416 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:45:23.771 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/127 2020-04-02T23:45:23.997 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:45:24.024 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:45:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:45:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:45:25.254 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/127 2020-04-02T23:45:25.445 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:45:25.787 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:45:25.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:45:29.658 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:45:29.658 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2020-04-02T23:45:29.658 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2020-04-02T23:45:29.658 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2020-04-02T23:45:29.658 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2020-04-02T23:45:29.658 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2020-04-02T23:45:29.659 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2020-04-02T23:45:29.659 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2020-04-02T23:45:29.659 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2020-04-02T23:45:29.659 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2020-04-02T23:45:29.659 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:29.900 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:45:30.067 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:45:30.280 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/127 2020-04-02T23:45:30.455 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:45:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:45:30.514 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:45:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:45:31.392 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/127 2020-04-02T23:45:31.673 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/127 2020-04-02T23:45:31.814 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/127 2020-04-02T23:45:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/127 2020-04-02T23:45:32.111 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/127 2020-04-02T23:45:32.235 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:45:32.316 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/127 2020-04-02T23:45:32.417 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:45:32.442 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:45:32.563 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/127 2020-04-02T23:45:32.754 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:45:32.779 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:45:32.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/127 2020-04-02T23:45:33.186 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:45:33.299 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:45:33.511 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:45:33.526 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:45:33.526 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:45:33.858 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:45:34.024 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:45:34.248 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:45:34.249 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:45:34.250 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:45:35.143 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:45:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/127 2020-04-02T23:45:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/127 2020-04-02T23:45:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 3/127 2020-04-02T23:45:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:45:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 5/127 2020-04-02T23:45:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:45:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:45:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 8/127 2020-04-02T23:45:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:45:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 10/127 2020-04-02T23:45:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 11/127 2020-04-02T23:45:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 12/127 2020-04-02T23:45:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 13/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 14/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 15/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 16/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 17/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 18/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 19/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 20/127 2020-04-02T23:45:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 21/127 2020-04-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 22/127 2020-04-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 23/127 2020-04-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 25/127 2020-04-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 26/127 2020-04-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 27/127 2020-04-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 28/127 2020-04-02T23:45:35.148 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 29/127 2020-04-02T23:45:35.148 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 30/127 2020-04-02T23:45:35.148 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 31/127 2020-04-02T23:45:35.148 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 32/127 2020-04-02T23:45:35.148 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 33/127 2020-04-02T23:45:35.148 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 34/127 2020-04-02T23:45:35.148 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.1-6.el8.noarch 35/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.5-12.el8.x86_64 38/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 42/127 2020-04-02T23:45:35.149 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 43/127 2020-04-02T23:45:35.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 44/127 2020-04-02T23:45:35.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 45/127 2020-04-02T23:45:35.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 46/127 2020-04-02T23:45:35.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 47/127 2020-04-02T23:45:35.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/127 2020-04-02T23:45:35.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/127 2020-04-02T23:45:35.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 50/127 2020-04-02T23:45:35.151 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 51/127 2020-04-02T23:45:35.151 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 52/127 2020-04-02T23:45:35.151 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 53/127 2020-04-02T23:45:35.151 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 54/127 2020-04-02T23:45:35.151 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 55/127 2020-04-02T23:45:35.151 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 56/127 2020-04-02T23:45:35.151 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 57/127 2020-04-02T23:45:35.152 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 58/127 2020-04-02T23:45:35.152 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 59/127 2020-04-02T23:45:35.152 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 60/127 2020-04-02T23:45:35.152 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 61/127 2020-04-02T23:45:35.152 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 62/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 63/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 64/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 65/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 66/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 67/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 68/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 69/127 2020-04-02T23:45:35.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 70/127 2020-04-02T23:45:35.154 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 71/127 2020-04-02T23:45:35.154 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 72/127 2020-04-02T23:45:35.154 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 73/127 2020-04-02T23:45:35.154 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 74/127 2020-04-02T23:45:35.154 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 75/127 2020-04-02T23:45:35.154 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 76/127 2020-04-02T23:45:35.154 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 77/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 78/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 79/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 80/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 81/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 83/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 84/127 2020-04-02T23:45:35.155 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 85/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 86/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 87/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 88/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 89/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 90/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 91/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 92/127 2020-04-02T23:45:35.156 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 93/127 2020-04-02T23:45:35.157 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 94/127 2020-04-02T23:45:35.157 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 95/127 2020-04-02T23:45:35.157 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 96/127 2020-04-02T23:45:35.157 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 97/127 2020-04-02T23:45:35.157 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 98/127 2020-04-02T23:45:35.157 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 99/127 2020-04-02T23:45:35.157 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 100/127 2020-04-02T23:45:35.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 101/127 2020-04-02T23:45:35.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 102/127 2020-04-02T23:45:35.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 103/127 2020-04-02T23:45:35.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 104/127 2020-04-02T23:45:35.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 105/127 2020-04-02T23:45:35.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 106/127 2020-04-02T23:45:35.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 107/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 108/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 109/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 110/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 111/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 112/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 113/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 114/127 2020-04-02T23:45:35.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 116/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 117/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 118/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 122/127 2020-04-02T23:45:35.160 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : leveldb-1.21-2.el8.x86_64 123/127 2020-04-02T23:45:35.161 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 124/127 2020-04-02T23:45:35.161 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/127 2020-04-02T23:45:35.161 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 126/127 2020-04-02T23:45:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:45:35.417 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:45:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:45:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:45:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:45:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2020-04-02T23:45:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2020-04-02T23:45:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:45:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:45:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:45:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:45:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:45:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:45:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:36.796 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:36.797 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:45:36.797 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:45:36.797 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:45:36.797 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:45:36.798 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:45:36.799 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:45:36.800 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:45:36.801 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:45:36.802 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:45:36.803 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:45:36.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:45:36.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:45:36.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:45:36.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:45:36.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:45:36.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:45:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:45:36.805 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:45:36.805 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:45:36.805 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:45:36.805 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:45:36.805 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:45:36.805 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:45:36.805 INFO:teuthology.orchestra.run.smithi082.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:45:36.806 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:45:36.807 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:45:36.807 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:45:36.807 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:45:36.807 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:45:36.807 INFO:teuthology.orchestra.run.smithi082.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:45:36.807 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2020-04-02T23:45:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:45:36.998 DEBUG:teuthology.parallel:result is None 2020-04-02T23:45:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/127 2020-04-02T23:45:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:45:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:45:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:45:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:45:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/127 2020-04-02T23:45:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:45:39.298 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:45:39.516 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:45:43.704 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:45:44.065 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/127 2020-04-02T23:45:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:45:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:45:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/127 2020-04-02T23:45:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/127 2020-04-02T23:45:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/127 2020-04-02T23:45:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/127 2020-04-02T23:45:46.573 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/127 2020-04-02T23:45:46.804 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/127 2020-04-02T23:45:47.011 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/127 2020-04-02T23:45:47.208 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:45:47.235 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:45:47.414 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/127 2020-04-02T23:45:47.640 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:45:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:45:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:45:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:45:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:45:48.226 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:45:48.227 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:45:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:45:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/127 2020-04-02T23:45:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/127 2020-04-02T23:45:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 3/127 2020-04-02T23:45:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:45:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 5/127 2020-04-02T23:45:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:45:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:45:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 8/127 2020-04-02T23:45:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:45:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 10/127 2020-04-02T23:45:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 11/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 12/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 13/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 14/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 15/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 16/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 17/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 18/127 2020-04-02T23:45:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 19/127 2020-04-02T23:45:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 20/127 2020-04-02T23:45:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 21/127 2020-04-02T23:45:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 22/127 2020-04-02T23:45:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 23/127 2020-04-02T23:45:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:45:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 25/127 2020-04-02T23:45:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 26/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 27/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 28/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 29/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 30/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 31/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 32/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 33/127 2020-04-02T23:45:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 34/127 2020-04-02T23:45:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.1-6.el8.noarch 35/127 2020-04-02T23:45:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/127 2020-04-02T23:45:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/127 2020-04-02T23:45:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.5-12.el8.x86_64 38/127 2020-04-02T23:45:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/127 2020-04-02T23:45:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/127 2020-04-02T23:45:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 42/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 43/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 44/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 45/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 46/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 47/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/127 2020-04-02T23:45:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/127 2020-04-02T23:45:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 50/127 2020-04-02T23:45:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 51/127 2020-04-02T23:45:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 52/127 2020-04-02T23:45:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 53/127 2020-04-02T23:45:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 54/127 2020-04-02T23:45:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 55/127 2020-04-02T23:45:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 56/127 2020-04-02T23:45:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 57/127 2020-04-02T23:45:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 58/127 2020-04-02T23:45:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 59/127 2020-04-02T23:45:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 60/127 2020-04-02T23:45:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 61/127 2020-04-02T23:45:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 62/127 2020-04-02T23:45:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 63/127 2020-04-02T23:45:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 64/127 2020-04-02T23:45:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 65/127 2020-04-02T23:45:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 66/127 2020-04-02T23:45:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 67/127 2020-04-02T23:45:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 68/127 2020-04-02T23:45:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 69/127 2020-04-02T23:45:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 70/127 2020-04-02T23:45:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 71/127 2020-04-02T23:45:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 72/127 2020-04-02T23:45:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 73/127 2020-04-02T23:45:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 74/127 2020-04-02T23:45:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 75/127 2020-04-02T23:45:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 76/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 77/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 78/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 79/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 80/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 81/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 83/127 2020-04-02T23:45:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 84/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 85/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 86/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 87/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 88/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 89/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 90/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 91/127 2020-04-02T23:45:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 92/127 2020-04-02T23:45:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 93/127 2020-04-02T23:45:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 94/127 2020-04-02T23:45:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 95/127 2020-04-02T23:45:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 96/127 2020-04-02T23:45:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 97/127 2020-04-02T23:45:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 98/127 2020-04-02T23:45:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 99/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 100/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 101/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 102/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 103/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 104/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 105/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 106/127 2020-04-02T23:45:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 107/127 2020-04-02T23:45:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 108/127 2020-04-02T23:45:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 109/127 2020-04-02T23:45:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 110/127 2020-04-02T23:45:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 111/127 2020-04-02T23:45:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 112/127 2020-04-02T23:45:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 113/127 2020-04-02T23:45:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 114/127 2020-04-02T23:45:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/127 2020-04-02T23:45:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 116/127 2020-04-02T23:45:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 117/127 2020-04-02T23:45:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 118/127 2020-04-02T23:45:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/127 2020-04-02T23:45:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/127 2020-04-02T23:45:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/127 2020-04-02T23:45:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 122/127 2020-04-02T23:45:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : leveldb-1.21-2.el8.x86_64 123/127 2020-04-02T23:45:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 124/127 2020-04-02T23:45:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/127 2020-04-02T23:45:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 126/127 2020-04-02T23:45:50.776 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:45:50.777 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:50.777 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2020-04-02T23:45:50.777 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.777 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.777 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:50.777 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2020-04-02T23:45:50.777 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.778 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.778 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.778 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.778 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.778 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.778 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.778 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.779 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.779 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.779 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.779 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.779 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.779 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.779 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:50.780 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:45:50.781 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:45:50.781 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:45:50.781 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:45:50.781 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:45:50.781 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:45:50.781 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:45:50.781 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:45:50.782 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:45:50.782 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:45:50.782 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.782 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.782 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.782 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.782 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.783 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.783 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.783 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.783 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:50.783 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:50.783 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:50.783 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:45:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:45:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:45:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:45:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:45:50.785 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:45:50.785 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:45:50.785 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:45:50.785 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:45:50.786 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:45:50.787 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:45:50.788 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:45:50.788 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:45:50.788 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:45:50.788 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:45:50.788 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:45:50.788 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:45:50.788 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:45:50.789 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:45:50.789 INFO:teuthology.orchestra.run.smithi050.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:45:50.789 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:45:50.789 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:45:50.789 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:45:50.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:45:50.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:45:50.790 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:45:50.790 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:45:50.791 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:45:50.791 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:45:50.791 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:45:50.791 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:45:50.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:45:50.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:45:50.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:45:50.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:45:50.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:45:50.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:45:50.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:45:50.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:45:50.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:45:50.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:45:50.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:45:50.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:45:50.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:45:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:45:50.795 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:45:50.796 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:45:50.796 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:45:50.796 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:45:50.796 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:45:50.796 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:45:50.796 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:50.797 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2020-04-02T23:45:50.955 DEBUG:teuthology.parallel:result is None 2020-04-02T23:45:50.956 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:50.972 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2020-04-02T23:45:51.064 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS 2020-04-02T23:45:51.065 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:45:51.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:45:51.308 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:51.323 INFO:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:45:51.385 INFO:teuthology.orchestra.run.smithi050.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:45:51.386 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:45:51.386 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:45:51.386 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:51.405 INFO:teuthology.orchestra.run.smithi082:> sudo lsb_release -is 2020-04-02T23:45:51.496 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS 2020-04-02T23:45:51.497 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:45:51.498 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:45:51.746 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:51.762 INFO:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:45:51.823 INFO:teuthology.orchestra.run.smithi082.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:45:51.823 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:45:51.823 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:45:51.824 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-02T23:45:51.824 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:51.838 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:45:51.910 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:51.926 INFO:teuthology.orchestra.run.smithi082:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:45:51.997 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-02T23:45:51.998 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:52.011 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:45:52.083 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:52.136 INFO:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:45:52.207 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:52.222 INFO:teuthology.orchestra.run.smithi082:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:45:52.295 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:52.350 INFO:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:45:52.419 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-02T23:45:52.420 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:52.434 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:45:52.519 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:52.572 INFO:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:45:52.643 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:52.659 INFO:teuthology.orchestra.run.smithi082:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:45:52.744 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:52.800 INFO:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:45:52.869 INFO:teuthology.run_tasks:Running task ceph... 2020-04-02T23:45:52.932 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-02T23:45:52.932 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:52.946 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2020-04-02T23:45:52.989 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:53.003 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2020-04-02T23:45:53.074 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-02T23:45:53.074 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:53.087 INFO:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:45:53.130 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:53.144 INFO:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:45:53.213 INFO:tasks.ceph:Creating extra log directories... 2020-04-02T23:45:53.213 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:53.227 INFO:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:45:53.270 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:53.284 INFO:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:45:53.351 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-04-02T23:45:53.351 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-04-02T23:45:53.351 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-04-02T23:45:53.352 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:53.365 INFO:teuthology.orchestra.run.smithi050:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:45:53.450 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:53.504 INFO:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:45:53.631 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:53.645 INFO:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:45:53.716 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:53.735 INFO:teuthology.orchestra.run.smithi082:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:45:53.819 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:53.874 INFO:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:45:53.992 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:54.006 INFO:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:45:54.073 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-02T23:45:54.074 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Replacing daemon mds', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'ms inject delay type': 'osd mds', 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'mon client directed command retry': 5, 'ms inject socket failures': 2500}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'mon osd backfillfull_ratio': 0.85, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd op complaint time': 180, 'bluestore fsck on mount': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}} 2020-04-02T23:45:54.074 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, {'ceph': None}, {'mds_thrash': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/snaps']}}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.14492', 'owner': 'scheduled_gregf@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'targets': {'smithi082.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ8kRsQ1GLiHQaqo311lNAVkRMWFnSSRqMRrN4HD18AFN9gsIwPaU/v1iX9UA9Ha1Z9nGTwZtMI4cunM8ZKng/j8dzd94DpAduimZF9lpLulZsVrRY2CtoWC55EW+OqjiazB+83srK4uyB6vPa3yrGiqWqwcglZ1mx2dJANNRq67WINl2TalDCuLtFR9QF9xG2acGrX0r/+JjTirNpqcAjoTc0eZgaaTbE8qIIQu2cfCL3TPtnDXyvHuvVt+Cxu8Ncvgektzluk9TvuU3cHLx4OwHYYX1ilHH4RXTGaRZz/p+BeIGxQ+4w50urN9I/H3DGEt8jTAlsVW699qEIT+unYsZZf2dEBb6g6f2OOH9Wh3MZc4E7luORi9K8crZpBlu5B6kCd4xsZ609+MoA+ojgFRbcxVR+VXH2ir1dcjm3O977H9a3b4fsTrU750447UcJrIDUl8ZFwJlIe7qCQ746qdOvCFGvDEzIGxZs4kDQZrBQEqTnqWDknstp+8/5mDU=', 'smithi050.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbmMf4jOHCgq29NGTOZJ0kVGW5vGKui1HIoOpL0hoHBwAf28qqSazK6A0Gv4Rjq/f56nA0N9p6cgNA/xSBPOFvYUdiBEYr3hJrQIw2GyhvBejxppeKtcrSX10t5qClXeQRrzAPOVTKaR/wy8Llf48wD+F0Cxh76IAlTNAiNEse1mRF7BflMzpd8a03YYPBZfbQRTdkXfuOWowMrMf0o+e4A5iY25jFts22Zb03AdzwAtyjSHIckJ1Nuh2QzowR+G6/kf87eMOFSrFSP4TXKtHCdnrIooB98jkaSV/PzXIqyEuiJOSAROE8/3/ZmpfIgZNqtSkn4BygjPlQT/JwqaL8KfaF6SMy+M0XC+SH3jAcgOxu20uXi2chaXKjDRliZDpK/HbZf3atq0sz7GxN6h4lQnR5NWMjZfiNDifAF+teJBYBLkn18f0/v/5U2skq1IU/kSR+syf9AG0uSHSemf+VWIV9vE1VqyDyYcPNw4eAbhXqy5TsYdEXoXHtw3T0yPs='}, 'job_id': '4919121', 'tube': 'smithi', 'suite_branch': 'wip-greg-testing-42', 'priority': 101, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'wip-greg-testing-42', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'gfarnum@redhat.com', 'archive_path': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919121', 'description': 'fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_snaptests.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'name': 'gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'overrides': {'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Replacing daemon mds', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'ms inject delay type': 'osd mds', 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'mon client directed command retry': 5, 'ms inject socket failures': 2500}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'mon osd backfillfull_ratio': 0.85, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd op complaint time': 180, 'bluestore fsck on mount': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}, 'fs': 'xfs', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'osd failsafe full ratio': 0.95}}}, 'install': {'ceph': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, 'admin_socket': {'branch': 'wip-greg-testing-42'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'branch': 'wip-greg-testing-42'}}, 'os_type': 'centos', 'suite_sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:45:54.074 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:54.089 INFO:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:45:54.131 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:54.150 INFO:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:45:54.204 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:54.218 INFO:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:45:54.260 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:54.273 INFO:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:45:54.362 DEBUG:teuthology.orchestra.remote:smithi050:/scratch_devs is 72B 2020-04-02T23:45:54.411 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:45:54.411 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:54.425 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:45:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:45:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:54.480 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 63536 Links: 1 2020-04-02T23:45:54.480 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:54.480 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:54.480 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2020-04-02 23:45:48.779020104 +0000 2020-04-02T23:45:54.480 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2020-04-02 23:43:54.572921322 +0000 2020-04-02T23:45:54.481 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2020-04-02 23:43:54.572921322 +0000 2020-04-02T23:45:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2020-04-02T23:45:54.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2020-04-02T23:45:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2020-04-02T23:45:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.9656e-05 s, 5.1 MB/s 2020-04-02T23:45:54.503 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:54.557 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:45:54.611 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:45:54.612 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:54.612 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 63590 Links: 1 2020-04-02T23:45:54.612 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:54.612 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:54.612 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2020-04-02 23:45:48.779020104 +0000 2020-04-02T23:45:54.612 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2020-04-02 23:43:54.898913306 +0000 2020-04-02T23:45:54.613 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2020-04-02 23:43:54.898913306 +0000 2020-04-02T23:45:54.613 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2020-04-02T23:45:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2020-04-02T23:45:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2020-04-02T23:45:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000102498 s, 5.0 MB/s 2020-04-02T23:45:54.637 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:54.690 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:45:54.745 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:45:54.745 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:54.745 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 55796 Links: 1 2020-04-02T23:45:54.745 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:54.745 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:54.745 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2020-04-02 23:45:48.779020104 +0000 2020-04-02T23:45:54.746 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2020-04-02 23:43:55.227905216 +0000 2020-04-02T23:45:54.746 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2020-04-02 23:43:55.227905216 +0000 2020-04-02T23:45:54.746 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2020-04-02T23:45:54.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2020-04-02T23:45:54.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2020-04-02T23:45:54.761 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.6388e-05 s, 5.3 MB/s 2020-04-02T23:45:54.763 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:54.821 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:45:54.875 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:45:54.876 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:54.876 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 62734 Links: 1 2020-04-02T23:45:54.876 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:54.876 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:54.876 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2020-04-02 23:45:48.779020104 +0000 2020-04-02T23:45:54.876 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2020-04-02 23:43:55.575896659 +0000 2020-04-02T23:45:54.877 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2020-04-02 23:43:55.575896659 +0000 2020-04-02T23:45:54.877 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2020-04-02T23:45:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2020-04-02T23:45:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2020-04-02T23:45:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.6341e-05 s, 5.3 MB/s 2020-04-02T23:45:54.895 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:45:54.913 DEBUG:teuthology.orchestra.remote:smithi082:/scratch_devs is 72B 2020-04-02T23:45:54.962 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:45:54.962 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:54.976 INFO:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:45:55.030 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:45:55.030 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:55.030 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 55250 Links: 1 2020-04-02T23:45:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2020-04-02 23:45:34.775006987 +0000 2020-04-02T23:45:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2020-04-02 23:43:52.087088219 +0000 2020-04-02T23:45:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2020-04-02 23:43:52.087088219 +0000 2020-04-02T23:45:55.031 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2020-04-02T23:45:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2020-04-02T23:45:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2020-04-02T23:45:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000199032 s, 2.6 MB/s 2020-04-02T23:45:55.046 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.100 INFO:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:45:55.154 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:45:55.154 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:55.154 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 56026 Links: 1 2020-04-02T23:45:55.155 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:55.155 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:55.155 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2020-04-02 23:45:34.775006987 +0000 2020-04-02T23:45:55.155 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2020-04-02 23:43:52.425032261 +0000 2020-04-02T23:45:55.155 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2020-04-02 23:43:52.425032261 +0000 2020-04-02T23:45:55.155 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2020-04-02T23:45:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2020-04-02T23:45:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2020-04-02T23:45:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000190025 s, 2.7 MB/s 2020-04-02T23:45:55.170 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.223 INFO:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:45:55.276 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:45:55.276 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:55.276 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 56089 Links: 1 2020-04-02T23:45:55.276 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:55.277 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:55.277 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2020-04-02 23:45:34.775006987 +0000 2020-04-02T23:45:55.277 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2020-04-02 23:43:52.761962406 +0000 2020-04-02T23:45:55.277 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2020-04-02 23:43:52.761962406 +0000 2020-04-02T23:45:55.277 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2020-04-02T23:45:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2020-04-02T23:45:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2020-04-02T23:45:55.290 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000203121 s, 2.5 MB/s 2020-04-02T23:45:55.292 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.345 INFO:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:45:55.398 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:45:55.399 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:45:55.399 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 61023 Links: 1 2020-04-02T23:45:55.399 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:45:55.399 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:45:55.399 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2020-04-02 23:45:34.776006965 +0000 2020-04-02T23:45:55.399 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2020-04-02 23:43:53.097892759 +0000 2020-04-02T23:45:55.399 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2020-04-02 23:43:53.097892759 +0000 2020-04-02T23:45:55.400 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2020-04-02T23:45:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2020-04-02T23:45:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2020-04-02T23:45:55.412 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000241253 s, 2.1 MB/s 2020-04-02T23:45:55.414 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:45:55.414 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:45:55.414 INFO:tasks.ceph:Generating config... 2020-04-02T23:45:55.416 INFO:tasks.ceph:[mds] mds debug frag = True 2020-04-02T23:45:55.416 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-04-02T23:45:55.416 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-04-02T23:45:55.416 INFO:tasks.ceph:[mds] debug mds = 20 2020-04-02T23:45:55.416 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-04-02T23:45:55.416 INFO:tasks.ceph:[mds] debug ms = 1 2020-04-02T23:45:55.416 INFO:tasks.ceph:[mds] mds bal frag = True 2020-04-02T23:45:55.417 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-04-02T23:45:55.417 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-04-02T23:45:55.417 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-04-02T23:45:55.417 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-04-02T23:45:55.417 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-04-02T23:45:55.417 INFO:tasks.ceph:[global] ms inject delay type = osd mds 2020-04-02T23:45:55.417 INFO:tasks.ceph:[global] ms inject delay max = 1 2020-04-02T23:45:55.417 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2020-04-02T23:45:55.418 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-04-02T23:45:55.418 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2020-04-02T23:45:55.418 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-04-02T23:45:55.418 INFO:tasks.ceph:[osd] debug ms = 1 2020-04-02T23:45:55.418 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-02T23:45:55.418 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-02T23:45:55.418 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-04-02T23:45:55.418 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-04-02T23:45:55.418 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-04-02T23:45:55.419 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-04-02T23:45:55.420 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-02T23:45:55.420 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-02T23:45:55.420 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-04-02T23:45:55.420 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-02T23:45:55.420 INFO:tasks.ceph:[client] debug ms = 1 2020-04-02T23:45:55.420 INFO:tasks.ceph:[client] debug client = 20 2020-04-02T23:45:55.420 INFO:tasks.ceph:[client] client mount timeout = 600 2020-04-02T23:45:55.420 INFO:tasks.ceph:Setting up mon.a... 2020-04-02T23:45:55.421 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.468 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-02T23:45:55.571 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.keyring 2020-04-02T23:45:55.573 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.586 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-02T23:45:55.668 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.722 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:45:55.789 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.82'), ('mon.c', '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]'), ('mon.b', '172.21.15.50')] 2020-04-02T23:45:55.789 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.842 INFO:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.82 --addv c '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]' --add b 172.21.15.50 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:45:55.917 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:45:55.917 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: generated fsid 9ad11b85-09ab-48b2-ad7c-5536462abc65 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 0 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 9ad11b85-09ab-48b2-ad7c-5536462abc65 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:last_changed 2020-04-02T23:45:55.916783+0000 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:created 2020-04-02T23:45:55.916783+0000 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:min_mon_release 0 (unknown) 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:1: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2020-04-02T23:45:55.918 INFO:teuthology.orchestra.run.smithi082.stdout:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2020-04-02T23:45:55.919 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-02T23:45:55.920 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9ad11b85-09ab-48b2-ad7c-5536462abc65... 2020-04-02T23:45:55.921 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:55.937 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:45:55.980 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:55.994 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:45:56.049 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2020-04-02T23:45:56.049 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2020-04-02T23:45:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:45:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2020-04-02T23:45:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2020-04-02T23:45:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2020-04-02T23:45:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.051 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2020-04-02T23:45:56.051 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2020-04-02T23:45:56.051 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.051 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2020-04-02T23:45:56.051 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2020-04-02T23:45:56.052 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.052 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:45:56.052 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2020-04-02T23:45:56.052 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.052 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:45:56.052 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:45:56.053 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.053 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2020-04-02T23:45:56.053 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.053 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2020-04-02T23:45:56.053 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2020-04-02T23:45:56.053 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:45:56.053 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:45:56.054 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2020-04-02T23:45:56.054 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:45:56.054 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2020-04-02T23:45:56.054 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:45:56.054 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:45:56.054 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2020-04-02T23:45:56.054 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.055 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:45:56.055 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.055 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2020-04-02T23:45:56.056 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.056 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2020-04-02T23:45:56.056 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.056 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2020-04-02T23:45:56.056 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2020-04-02T23:45:56.056 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.82,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.50" 2020-04-02T23:45:56.057 INFO:teuthology.orchestra.run.smithi050.stdout: ms inject delay type = osd mds 2020-04-02T23:45:56.057 INFO:teuthology.orchestra.run.smithi050.stdout: ms inject delay max = 1 2020-04-02T23:45:56.057 INFO:teuthology.orchestra.run.smithi050.stdout: ms inject delay probability = 0.005 2020-04-02T23:45:56.057 INFO:teuthology.orchestra.run.smithi050.stdout: mon client directed command retry = 5 2020-04-02T23:45:56.057 INFO:teuthology.orchestra.run.smithi050.stdout: ms inject socket failures = 2500 2020-04-02T23:45:56.057 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 9ad11b85-09ab-48b2-ad7c-5536462abc65 2020-04-02T23:45:56.057 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2020-04-02T23:45:56.058 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2020-04-02T23:45:56.059 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.059 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2020-04-02T23:45:56.059 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2020-04-02T23:45:56.059 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2020-04-02T23:45:56.059 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.059 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2020-04-02T23:45:56.059 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.060 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:45:56.061 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2020-04-02T23:45:56.061 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.061 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2020-04-02T23:45:56.061 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2020-04-02T23:45:56.061 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2020-04-02T23:45:56.061 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2020-04-02T23:45:56.061 INFO:teuthology.orchestra.run.smithi050.stdout: debug journal = 20 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 25 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2020-04-02T23:45:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: debug filestore = 20 2020-04-02T23:45:56.063 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2020-04-02T23:45:56.063 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2020-04-02T23:45:56.063 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2020-04-02T23:45:56.063 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2020-04-02T23:45:56.063 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.063 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2020-04-02T23:45:56.063 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2020-04-02T23:45:56.064 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2020-04-02T23:45:56.064 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2020-04-02T23:45:56.064 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2020-04-02T23:45:56.064 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:45:56.064 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:45:56.064 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2020-04-02T23:45:56.064 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.065 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2020-04-02T23:45:56.065 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2020-04-02T23:45:56.065 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2020-04-02T23:45:56.066 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2020-04-02T23:45:56.066 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2020-04-02T23:45:56.066 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2020-04-02T23:45:56.066 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2020-04-02T23:45:56.066 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:45:56.066 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2020-04-02T23:45:56.066 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2020-04-02T23:45:56.067 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2020-04-02T23:45:56.068 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2020-04-02T23:45:56.069 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2020-04-02T23:45:56.069 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2020-04-02T23:45:56.069 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2020-04-02T23:45:56.069 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal split bits = 3 2020-04-02T23:45:56.069 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal split size = 100 2020-04-02T23:45:56.069 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2020-04-02T23:45:56.069 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal merge size = 5 2020-04-02T23:45:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2020-04-02T23:45:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal frag = True 2020-04-02T23:45:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal fragment size max = 10000 2020-04-02T23:45:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2020-04-02T23:45:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2020-04-02T23:45:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2020-04-02T23:45:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2020-04-02T23:45:56.087 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2020-04-02T23:45:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2020-04-02T23:45:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:45:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2020-04-02T23:45:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2020-04-02T23:45:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2020-04-02T23:45:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2020-04-02T23:45:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2020-04-02T23:45:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2020-04-02T23:45:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2020-04-02T23:45:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:45:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2020-04-02T23:45:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2020-04-02T23:45:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2020-04-02T23:45:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:45:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2020-04-02T23:45:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2020-04-02T23:45:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.82,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.50" 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: ms inject delay type = osd mds 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: ms inject delay max = 1 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: ms inject delay probability = 0.005 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: mon client directed command retry = 5 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: ms inject socket failures = 2500 2020-04-02T23:45:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 9ad11b85-09ab-48b2-ad7c-5536462abc65 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2020-04-02T23:45:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2020-04-02T23:45:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2020-04-02T23:45:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2020-04-02T23:45:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2020-04-02T23:45:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2020-04-02T23:45:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2020-04-02T23:45:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:45:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2020-04-02T23:45:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2020-04-02T23:45:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:45:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2020-04-02T23:45:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: debug journal = 20 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 25 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2020-04-02T23:45:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: debug filestore = 20 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2020-04-02T23:45:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2020-04-02T23:45:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.100 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2020-04-02T23:45:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2020-04-02T23:45:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2020-04-02T23:45:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2020-04-02T23:45:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2020-04-02T23:45:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2020-04-02T23:45:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2020-04-02T23:45:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:45:56.103 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2020-04-02T23:45:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2020-04-02T23:45:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2020-04-02T23:45:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2020-04-02T23:45:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:45:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:45:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2020-04-02T23:45:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2020-04-02T23:45:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2020-04-02T23:45:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: mds bal split bits = 3 2020-04-02T23:45:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: mds bal split size = 100 2020-04-02T23:45:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2020-04-02T23:45:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: mds bal merge size = 5 2020-04-02T23:45:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2020-04-02T23:45:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: mds bal frag = True 2020-04-02T23:45:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: mds bal fragment size max = 10000 2020-04-02T23:45:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2020-04-02T23:45:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2020-04-02T23:45:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2020-04-02T23:45:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2020-04-02T23:45:56.108 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-02T23:45:56.109 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:56.121 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-02T23:45:56.223 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-02T23:45:56.240 DEBUG:teuthology.orchestra.remote:smithi082:/etc/ceph/ceph.keyring is 206B 2020-04-02T23:45:56.341 DEBUG:teuthology.orchestra.remote:smithi082:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-02T23:45:56.389 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:45:56.389 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:56.405 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:45:56.509 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:56.565 INFO:teuthology.orchestra.run.smithi050:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:45:56.651 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:45:56.651 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:56.666 INFO:teuthology.orchestra.run.smithi082:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:45:56.808 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:56.822 INFO:teuthology.orchestra.run.smithi082:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:45:56.910 INFO:tasks.ceph:Setting up mon nodes... 2020-04-02T23:45:56.910 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-02T23:45:56.911 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:56.927 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:45:57.083 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:45:57.085 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:45:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:45:57.203 INFO:tasks.ceph:Setting up mds nodes... 2020-04-02T23:45:57.204 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:57.221 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:45:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:45:57.331 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:57.345 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-04-02T23:45:57.418 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:57.434 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:45:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:45:57.537 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:57.552 INFO:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-04-02T23:45:57.620 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-02T23:45:57.620 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:45:57.673 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-02T23:45:57.754 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-02T23:45:57.770 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-02T23:45:57.770 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:45:57.770 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:57.786 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-02T23:45:57.861 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:45:57.861 INFO:tasks.ceph:role: osd.4 2020-04-02T23:45:57.861 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:45:57.861 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:57.917 INFO:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:45:58.016 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:45:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:45:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:45:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2020-04-02T23:45:58.016 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:45:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:45:58.017 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:45:58.017 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:45:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:45:58.017 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:45:58.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2020-04-02T23:45:58.018 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.036 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-02T23:45:58.122 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.136 INFO:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-02T23:45:58.210 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.264 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-02T23:45:58.335 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:45:58.335 INFO:tasks.ceph:role: osd.5 2020-04-02T23:45:58.335 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:45:58.335 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.388 INFO:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:45:58.483 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:45:58.483 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:45:58.483 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:45:58.484 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2020-04-02T23:45:58.484 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:45:58.484 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:45:58.484 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:45:58.484 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:45:58.484 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:45:58.484 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:45:58.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2020-04-02T23:45:58.486 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.500 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-02T23:45:58.583 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.638 INFO:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-02T23:45:58.711 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.765 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-02T23:45:58.836 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:45:58.836 INFO:tasks.ceph:role: osd.6 2020-04-02T23:45:58.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:45:58.837 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:58.890 INFO:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:45:58.985 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:45:58.985 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:45:58.985 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:45:58.986 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2020-04-02T23:45:58.986 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:45:58.986 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:45:58.986 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:45:58.986 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:45:58.986 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:45:58.986 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:45:58.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2020-04-02T23:45:58.988 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:59.001 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-02T23:45:59.084 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:59.139 INFO:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-02T23:45:59.212 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:59.266 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-02T23:45:59.337 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:45:59.337 INFO:tasks.ceph:role: osd.7 2020-04-02T23:45:59.337 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2020-04-02T23:45:59.338 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:59.391 INFO:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:45:59.487 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:45:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:45:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:45:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2020-04-02T23:45:59.488 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:45:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:45:59.488 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:45:59.488 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:45:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:45:59.489 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:45:59.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2020-04-02T23:45:59.490 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:59.503 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-02T23:45:59.587 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:59.642 INFO:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-02T23:45:59.717 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:45:59.772 INFO:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:45:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:45:59.868+0000 7fb8f0ba7ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-02T23:45:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:45:59.868+0000 7fb8f0ba7ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-02T23:45:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:45:59.868+0000 7fb8f0ba7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:45:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:45:59.868+0000 7fb8f0ba7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:45:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:45:59.868+0000 7fb8f0ba7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:45:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:45:59.868+0000 7fb8f0ba7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-04-02T23:46:02.208 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:02.225 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-02T23:46:02.301 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:02.359 INFO:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:02.451+0000 7f24f42bbec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-02T23:46:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:02.452+0000 7f24f42bbec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-02T23:46:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:02.452+0000 7f24f42bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:46:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:02.452+0000 7f24f42bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:46:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:02.452+0000 7f24f42bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:46:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:02.452+0000 7f24f42bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-04-02T23:46:04.788 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:04.807 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-02T23:46:04.883 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:04.938 INFO:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:05.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:05.029+0000 7fdfaf8c6ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-02T23:46:05.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:05.030+0000 7fdfaf8c6ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-02T23:46:05.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:05.030+0000 7fdfaf8c6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:46:05.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:05.030+0000 7fdfaf8c6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:46:05.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:05.030+0000 7fdfaf8c6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:46:05.033 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:05.030+0000 7fdfaf8c6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-04-02T23:46:07.373 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:07.471 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-02T23:46:07.548 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:07.605 INFO:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:07.700+0000 7f9fe500eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-02T23:46:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:07.700+0000 7f9fe500eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-02T23:46:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:07.700+0000 7f9fe500eec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:46:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:07.700+0000 7f9fe500eec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:46:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:07.700+0000 7f9fe500eec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:46:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:46:07.700+0000 7f9fe500eec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-04-02T23:46:10.042 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:10.074 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-02T23:46:10.169 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:10.186 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:10.259 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:10.259 INFO:tasks.ceph:role: osd.0 2020-04-02T23:46:10.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:46:10.260 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:10.325 INFO:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:46:10.868 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:10.868 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:10.868 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:10.868 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2020-04-02T23:46:10.868 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:10.868 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:10.869 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:10.869 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:10.869 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:10.869 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:10.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2020-04-02T23:46:10.870 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:10.887 INFO:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:11.031 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:11.045 INFO:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:11.117 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:11.171 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:11.244 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:11.244 INFO:tasks.ceph:role: osd.1 2020-04-02T23:46:11.244 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:46:11.244 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:11.297 INFO:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:46:11.818 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:11.818 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:11.818 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:11.819 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2020-04-02T23:46:11.819 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:11.819 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:11.819 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:11.819 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:11.820 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:11.820 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:11.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2020-04-02T23:46:11.822 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:11.835 INFO:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:11.945 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:11.959 INFO:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:12.028 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:12.082 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:12.148 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:12.148 INFO:tasks.ceph:role: osd.2 2020-04-02T23:46:12.148 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:46:12.149 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:12.202 INFO:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:46:12.733 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:12.733 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:12.733 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:12.734 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2020-04-02T23:46:12.734 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:12.734 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:12.734 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:12.734 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:12.734 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:12.735 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:12.736 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2020-04-02T23:46:12.736 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:12.749 INFO:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:12.905 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:12.919 INFO:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:12.989 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:13.043 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:13.110 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:13.110 INFO:tasks.ceph:role: osd.3 2020-04-02T23:46:13.110 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2020-04-02T23:46:13.111 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:13.164 INFO:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:46:13.666 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:13.666 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:13.666 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:13.666 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2020-04-02T23:46:13.666 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:13.667 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:13.667 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:13.667 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:13.667 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:13.667 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:13.668 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2020-04-02T23:46:13.669 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:13.682 INFO:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:13.786 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:13.799 INFO:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:13.869 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:13.921 INFO:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:14.015+0000 7fd359f4cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-02T23:46:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:14.017+0000 7fd359f4cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-02T23:46:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:14.017+0000 7fd359f4cec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:46:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:14.017+0000 7fd359f4cec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:46:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:14.017+0000 7fd359f4cec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:46:14.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:14.021+0000 7fd359f4cec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-04-02T23:46:16.362 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:16.377 INFO:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:16.447 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:16.503 INFO:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:16.586+0000 7f6c38d50ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-02T23:46:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:16.587+0000 7f6c38d50ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-02T23:46:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:16.587+0000 7f6c38d50ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:46:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:16.587+0000 7f6c38d50ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:46:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:16.587+0000 7f6c38d50ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:46:16.590 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:16.587+0000 7f6c38d50ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-04-02T23:46:18.927 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:18.945 INFO:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:19.016 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:19.071 INFO:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:19.155+0000 7f7a121fbec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-02T23:46:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:19.155+0000 7f7a121fbec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-02T23:46:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:19.155+0000 7f7a121fbec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:46:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:19.155+0000 7f7a121fbec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:46:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:19.155+0000 7f7a121fbec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:46:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:19.156+0000 7f7a121fbec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-04-02T23:46:21.502 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:21.518 INFO:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:21.589 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:21.644 INFO:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:21.729+0000 7f6909ecaec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-02T23:46:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:21.730+0000 7f6909ecaec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-02T23:46:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:21.730+0000 7f6909ecaec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:46:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:21.730+0000 7f6909ecaec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:46:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:21.730+0000 7f6909ecaec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:46:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:21.730+0000 7f6909ecaec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-04-02T23:46:24.073 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:24.075 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.095 INFO:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:24.096 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:24.137 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:24.153 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:24.167 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-02T23:46:24.168 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.193 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:24.274 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.opL6zWNTlq 2020-04-02T23:46:24.274 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.329 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.opL6zWNTlq 2020-04-02T23:46:24.403 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.458 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.opL6zWNTlq 2020-04-02T23:46:24.589 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.opL6zWNTlq is 56B 2020-04-02T23:46:24.639 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.652 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.opL6zWNTlq 2020-04-02T23:46:24.706 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.760 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.JXxKlau40X 2020-04-02T23:46:24.814 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.867 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.JXxKlau40X 2020-04-02T23:46:24.939 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:24.992 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.JXxKlau40X 2020-04-02T23:46:25.123 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.JXxKlau40X is 56B 2020-04-02T23:46:25.171 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:25.189 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.JXxKlau40X 2020-04-02T23:46:25.241 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:25.294 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:25.348 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.dUrVp8ZzZ5 2020-04-02T23:46:25.349 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:25.402 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.dUrVp8ZzZ5 2020-04-02T23:46:25.473 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:25.527 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.dUrVp8ZzZ5 2020-04-02T23:46:25.655 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.dUrVp8ZzZ5 is 56B 2020-04-02T23:46:25.704 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:25.717 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.dUrVp8ZzZ5 2020-04-02T23:46:25.770 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:25.824 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:25.877 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.LQgwDv3e0B 2020-04-02T23:46:25.878 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:25.931 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.LQgwDv3e0B 2020-04-02T23:46:26.001 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.057 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.LQgwDv3e0B 2020-04-02T23:46:26.184 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.LQgwDv3e0B is 56B 2020-04-02T23:46:26.232 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.245 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.LQgwDv3e0B 2020-04-02T23:46:26.299 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.353 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:26.410 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.2Tv98G6hP3 2020-04-02T23:46:26.410 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.465 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.2Tv98G6hP3 2020-04-02T23:46:26.536 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.590 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.2Tv98G6hP3 2020-04-02T23:46:26.718 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.2Tv98G6hP3 is 56B 2020-04-02T23:46:26.768 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.782 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.2Tv98G6hP3 2020-04-02T23:46:26.835 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:26.944 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.Yl5MyOIGvG 2020-04-02T23:46:26.944 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:26.997 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.Yl5MyOIGvG 2020-04-02T23:46:27.069 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:27.122 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.Yl5MyOIGvG 2020-04-02T23:46:27.251 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.Yl5MyOIGvG is 56B 2020-04-02T23:46:27.300 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:27.314 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.Yl5MyOIGvG 2020-04-02T23:46:27.367 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:27.383 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.JGs6sgueTZ 2020-04-02T23:46:27.440 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:27.495 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.JGs6sgueTZ 2020-04-02T23:46:27.566 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:27.620 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.JGs6sgueTZ 2020-04-02T23:46:27.752 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.JGs6sgueTZ is 56B 2020-04-02T23:46:27.811 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:27.827 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.JGs6sgueTZ 2020-04-02T23:46:27.880 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:27.935 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:27.989 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.hodUxVelcf 2020-04-02T23:46:27.989 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.042 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.hodUxVelcf 2020-04-02T23:46:28.110 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.164 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.hodUxVelcf 2020-04-02T23:46:28.292 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.hodUxVelcf is 56B 2020-04-02T23:46:28.340 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.353 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.hodUxVelcf 2020-04-02T23:46:28.406 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.458 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:28.512 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.Q7XcaCH6QZ 2020-04-02T23:46:28.513 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.566 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.Q7XcaCH6QZ 2020-04-02T23:46:28.633 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.686 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.Q7XcaCH6QZ 2020-04-02T23:46:28.810 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.Q7XcaCH6QZ is 56B 2020-04-02T23:46:28.859 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.Q7XcaCH6QZ 2020-04-02T23:46:28.925 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:28.979 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:29.032 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.2eFCZWZspV 2020-04-02T23:46:29.033 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:29.086 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.2eFCZWZspV 2020-04-02T23:46:29.157 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:29.211 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.2eFCZWZspV 2020-04-02T23:46:29.335 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.2eFCZWZspV is 56B 2020-04-02T23:46:29.383 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:29.398 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.2eFCZWZspV 2020-04-02T23:46:29.451 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:29.503 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:29.557 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.utjQZ9NwKj 2020-04-02T23:46:29.558 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:29.610 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.utjQZ9NwKj 2020-04-02T23:46:29.677 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:29.731 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.utjQZ9NwKj 2020-04-02T23:46:29.854 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.utjQZ9NwKj is 56B 2020-04-02T23:46:29.902 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:29.915 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.utjQZ9NwKj 2020-04-02T23:46:29.968 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:30.020 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:30.074 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.TJHvWyhoLW 2020-04-02T23:46:30.074 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:30.126 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.TJHvWyhoLW 2020-04-02T23:46:30.195 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:30.248 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.TJHvWyhoLW 2020-04-02T23:46:30.379 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.TJHvWyhoLW is 56B 2020-04-02T23:46:30.426 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:30.439 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.TJHvWyhoLW 2020-04-02T23:46:30.547 DEBUG:teuthology.orchestra.remote:smithi082:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-02T23:46:30.597 INFO:tasks.ceph:Adding keys to all mons... 2020-04-02T23:46:30.597 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:30.614 INFO:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:46:30.656 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:30.669 INFO:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:46:30.712 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2020-04-02T23:46:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA1eYZeTI3pBBAAGtT/JbNZZFGJSfn1H1O1YQ== 2020-04-02T23:46:30.712 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2020-04-02T23:46:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA1eYZeBJOIExAAmMuN8bBD4veuVqyJO2XtnA== 2020-04-02T23:46:30.712 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2020-04-02T23:46:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA3eYZeiQXNMxAA9r8QDJmY7ZK9x6YTUaT0lg== 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA6eYZeM8n7GhAA/UlNBQWbI2pzVQqDgSAjBA== 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA9eYZed87UARAA/djiMMBEHkfT0iJSSZqovg== 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA/eYZe90bKKRAAaUI65BbWAg7aHXlAICrpwg== 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2020-04-02T23:46:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA1eYZeK6f4CxAA5e19T3IR1VnokD33Thm1AA== 2020-04-02T23:46:30.714 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2020-04-02T23:46:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA1eYZeJ0rdHxAAJ0mp33EEDlWHKs9kV0w/tw== 2020-04-02T23:46:30.714 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2020-04-02T23:46:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGeYZeRqD5ABAAkkF8ZAYPegXfheyAB9jGgg== 2020-04-02T23:46:30.714 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2020-04-02T23:46:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBIeYZe4ccGIxAA2w/J27oR/LB8mB+Haq+q6Q== 2020-04-02T23:46:30.714 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2020-04-02T23:46:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBLeYZeGaxPCRAA637dglqCpUsUaMad8XdlYg== 2020-04-02T23:46:30.715 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2020-04-02T23:46:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBNeYZeimmMKxAAOioOHsIdPUUw6iGs1uFRSA== 2020-04-02T23:46:30.715 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2020-04-02T23:46:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA1eYZe5N7vLBAASv/O6wJXHgx0NqWfH6fjMw== 2020-04-02T23:46:30.734 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2020-04-02T23:46:30.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA1eYZeTI3pBBAAGtT/JbNZZFGJSfn1H1O1YQ== 2020-04-02T23:46:30.735 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2020-04-02T23:46:30.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA1eYZeBJOIExAAmMuN8bBD4veuVqyJO2XtnA== 2020-04-02T23:46:30.735 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2020-04-02T23:46:30.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA3eYZeiQXNMxAA9r8QDJmY7ZK9x6YTUaT0lg== 2020-04-02T23:46:30.735 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2020-04-02T23:46:30.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA6eYZeM8n7GhAA/UlNBQWbI2pzVQqDgSAjBA== 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA9eYZed87UARAA/djiMMBEHkfT0iJSSZqovg== 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA/eYZe90bKKRAAaUI65BbWAg7aHXlAICrpwg== 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA1eYZeK6f4CxAA5e19T3IR1VnokD33Thm1AA== 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2020-04-02T23:46:30.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA1eYZeJ0rdHxAAJ0mp33EEDlWHKs9kV0w/tw== 2020-04-02T23:46:30.737 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2020-04-02T23:46:30.737 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBGeYZeRqD5ABAAkkF8ZAYPegXfheyAB9jGgg== 2020-04-02T23:46:30.737 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2020-04-02T23:46:30.737 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBIeYZe4ccGIxAA2w/J27oR/LB8mB+Haq+q6Q== 2020-04-02T23:46:30.737 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2020-04-02T23:46:30.737 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBLeYZeGaxPCRAA637dglqCpUsUaMad8XdlYg== 2020-04-02T23:46:30.737 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2020-04-02T23:46:30.738 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBNeYZeimmMKxAAOioOHsIdPUUw6iGs1uFRSA== 2020-04-02T23:46:30.738 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2020-04-02T23:46:30.738 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA1eYZe5N7vLBAASv/O6wJXHgx0NqWfH6fjMw== 2020-04-02T23:46:30.739 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:30.773 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:46:30.816 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:30.829 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:46:30.917 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:30.933 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:46:30.975 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:30.988 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.078 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:31.093 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.135 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:31.148 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.235 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:31.250 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.292 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:31.305 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.393 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:31.407 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.450 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:31.463 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.549 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:31.563 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.606 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:31.619 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.706 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:31.720 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:46:31.763 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:31.776 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:46:31.863 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:31.877 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:46:31.920 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:31.933 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.024 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:32.038 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.080 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:32.093 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.313 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:32.328 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.372 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:32.385 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.473 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:32.487 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.529 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:32.543 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.630 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:32.644 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.687 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:32.701 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:46:32.788 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:32.802 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:46:32.845 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:32.858 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:46:32.949 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-02T23:46:32.949 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:32.963 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-02T23:46:33.034 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:33.088 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:46:33.185 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:33.198 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-02T23:46:33.269 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:33.323 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-02T23:46:33.394 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:33.449 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:46:33.547 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:33.561 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-02T23:46:33.631 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:33.652 INFO:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-02T23:46:33.722 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:33.780 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:46:33.876 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:33.890 INFO:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-02T23:46:33.957 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:33.973 INFO:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:34.016 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:34.030 INFO:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:34.084 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-02T23:46:34.084 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-02T23:46:34.084 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:34.098 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-02T23:46:34.145 INFO:tasks.ceph.mon.b:Started 2020-04-02T23:46:34.145 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-02T23:46:34.145 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:34.160 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-02T23:46:34.203 INFO:tasks.ceph.mon.c:Started 2020-04-02T23:46:34.203 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-02T23:46:34.203 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:34.216 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-02T23:46:34.260 INFO:tasks.ceph.mon.a:Started 2020-04-02T23:46:34.260 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-02T23:46:34.260 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-02T23:46:34.261 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:34.281 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-02T23:46:34.324 INFO:tasks.ceph.mgr.x:Started 2020-04-02T23:46:34.324 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-02T23:46:34.324 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:34.341 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-02T23:46:34.384 INFO:tasks.ceph.mgr.y:Started 2020-04-02T23:46:34.384 INFO:tasks.ceph:Setting crush tunables to default 2020-04-02T23:46:34.385 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:34.398 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd crush tunables default 2020-04-02T23:46:39.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.544+0000 7f40d0b6f700 1 Processor -- start 2020-04-02T23:46:39.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.544+0000 7f40d0b6f700 1 -- start start 2020-04-02T23:46:39.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.544+0000 7f40d0b6f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40d0b6f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0a4bd0 con 0x7f40cc0a6e80 2020-04-02T23:46:39.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40d0b6f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0605c0 con 0x7f40cc080560 2020-04-02T23:46:39.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40d0b6f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0a33d0 con 0x7f40cc07fca0 2020-04-02T23:46:39.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40cb59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f40cc080560 0x7f40cc14fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53344/0 (socket says 172.21.15.82:53344) 2020-04-02T23:46:39.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 learned_addr learned my addr 172.21.15.82:0/1455279223 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:39.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 msgr2=0x7f40cc080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:46:39.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 msgr2=0x7f40cc080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.545+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:46:39.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.746+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.746+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 msgr2=0x7f40cc080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:46:39.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.746+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 msgr2=0x7f40cc080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.746+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:34.746+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:46:39.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.147+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.147+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 msgr2=0x7f40cc080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:46:39.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.147+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 msgr2=0x7f40cc080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.147+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.147+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:46:39.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 msgr2=0x7f40cc080100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:46:39.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc07fca0 0x7f40cc080100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:39.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 >> v1:172.21.15.82:6789/0 conn(0x7f40cc080560 legacy=0x7f40cc14fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 >> v1:172.21.15.50:6789/0 conn(0x7f40cc0a6e80 legacy=0x7f40cc05b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0a33d0 con 0x7f40ac005dc0 2020-04-02T23:46:39.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac04c8c0 con 0x7f40ac0033d0 2020-04-02T23:46:39.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:46:39.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:46:39.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:46:39.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.545+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:46:39.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:46:39.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:35.746+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:46:39.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:46:39.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:46:39.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:46:39.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.147+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:46:39.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:46:39.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40c3fff700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:36.948+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 msgr2=0x7f40ac005850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.82:3300/0 conn(0x7f40ac0033d0 0x7f40ac005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:39.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 reap_dead start 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc05b720 con 0x7f40cc0a6e80 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0a33d0 con 0x7f40ac005dc0 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40c959a700 1 -- 172.21.15.82:0/1455279223 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac04c8c0 con 0x7f40ac003840 2020-04-02T23:46:39.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.545+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40ac003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:46:39.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40ac003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:46:39.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:46:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.546+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:46:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40ac003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:46:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40ac003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:46:39.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:46:39.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:38.747+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:46:39.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:46:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:46:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40ac003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:46:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40ac003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:46:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.148+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:46:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.481+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678860955 0 0) 0x7f40cc05b720 con 0x7f40cc0a6e80 2020-04-02T23:46:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.481+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b8003230 con 0x7f40cc0a6e80 2020-04-02T23:46:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.481+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1283603909 0 0) 0x7f40b8003230 con 0x7f40cc0a6e80 2020-04-02T23:46:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40ac003cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:46:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40ac003cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 msgr2=0x7f40ac008200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:46:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 --2- 172.21.15.82:0/1455279223 >> v2:172.21.15.50:3300/0 conn(0x7f40ac005dc0 0x7f40ac008200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0051d0 con 0x7f40cc0a6e80 2020-04-02T23:46:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f40b4002350 con 0x7f40cc0a6e80 2020-04-02T23:46:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 >> v1:172.21.15.50:6789/0 conn(0x7f40cc0a6e80 legacy=0x7f40ac04ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40b80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b8004930 0x7f40b8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0a33d0 con 0x7f40b8004930 2020-04-02T23:46:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac04c8c0 con 0x7f40b8003720 2020-04-02T23:46:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8005380 con 0x7f40ac003840 2020-04-02T23:46:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40c3fff700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40b80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cb59e700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b8004930 0x7f40b8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 msgr2=0x7f40b80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40ac003840 0x7f40b80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b8004930 msgr2=0x7f40b8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b8004930 0x7f40b8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 -- 172.21.15.82:0/1455279223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8003230 con 0x7f40b8003720 2020-04-02T23:46:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f40cc0a3750 tx=0x7f40bc00c0e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f40cc0a3750 tx=0x7f40bc00c0e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.482+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f40cc0a3750 tx=0x7f40bc00c0e0).ready entity=mon.1 client_cookie=174a68284ecf2ec0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f40cc0a3750 tx=0x7f40bc00c0e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc001e70 con 0x7f40b8003720 2020-04-02T23:46:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f40cc0a3750 tx=0x7f40bc00c0e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40cad9d700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f40cc0a3750 tx=0x7f40bc00c0e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc010700 con 0x7f40b8003720 2020-04-02T23:46:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40ca59c700 1 -- 172.21.15.82:0/1455279223 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc010b20 con 0x7f40b8003720 2020-04-02T23:46:39.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40d0b6f700 1 -- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 msgr2=0x7f40b8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40d0b6f700 1 --2- 172.21.15.82:0/1455279223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b8003720 0x7f40b8003b40 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f40cc0a3750 tx=0x7f40bc00c0e0).stop 2020-04-02T23:46:39.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.485+0000 7f40cb59e700 1 -- 172.21.15.82:0/1455279223 reap_dead start 2020-04-02T23:46:39.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.486+0000 7f40d0b6f700 1 -- 172.21.15.82:0/1455279223 shutdown_connections 2020-04-02T23:46:39.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.486+0000 7f40d0b6f700 1 -- 172.21.15.82:0/1455279223 >> 172.21.15.82:0/1455279223 conn(0x7f40cc0aad00 msgr2=0x7f40cc0ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:39.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.486+0000 7f40d0b6f700 1 -- 172.21.15.82:0/1455279223 shutdown_connections 2020-04-02T23:46:39.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.486+0000 7f40d0b6f700 1 -- 172.21.15.82:0/1455279223 wait complete. 2020-04-02T23:46:39.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.487+0000 7f40d0b6f700 1 Processor -- start 2020-04-02T23:46:39.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.487+0000 7f40d0b6f700 1 -- start start 2020-04-02T23:46:39.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40d0b6f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40cc123ce0 0x7f40cc062350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:39.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40d0b6f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 0x7f40cc0a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:39.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40d0b6f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:39.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40d0b6f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc066a50 con 0x7f40cc123ce0 2020-04-02T23:46:39.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40d0b6f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0618f0 con 0x7f40cc144860 2020-04-02T23:46:39.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40d0b6f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc063a10 con 0x7f40cc0a0330 2020-04-02T23:46:39.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40cb59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40cad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40cc123ce0 0x7f40cc062350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40cb59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53386/0 (socket says 172.21.15.82:53386) 2020-04-02T23:46:39.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40cb59e700 1 -- 172.21.15.82:0/3961189884 learned_addr learned my addr 172.21.15.82:0/3961189884 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:39.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.488+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 0x7f40cc0a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 -- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 msgr2=0x7f40cc0a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 0x7f40cc0a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 -- 172.21.15.82:0/3961189884 >> v2:172.21.15.50:3300/0 conn(0x7f40cc123ce0 msgr2=0x7f40cc062350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.50:3300/0 conn(0x7f40cc123ce0 0x7f40cc062350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 -- 172.21.15.82:0/3961189884 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc063cb0 con 0x7f40cc144860 2020-04-02T23:46:39.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cad9d700 1 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.50:3300/0 conn(0x7f40cc123ce0 0x7f40cc062350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:39.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 -- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 msgr2=0x7f40cc144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-04-02T23:46:39.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 -- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 msgr2=0x7f40cc144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-04-02T23:46:39.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40cc0a62b0 tx=0x7f40c40109e0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:39.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.489+0000 7f40cb59e700 1 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:46:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40cb59e700 1 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40cb59e700 0 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-04-02T23:46:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40cb59e700 1 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 msgr2=0x7f40cc144cf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-04-02T23:46:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 --2- 172.21.15.82:0/3961189884 >> v2:172.21.15.82:3300/0 conn(0x7f40cc144860 0x7f40cc144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b000ade0 con 0x7f40b0006ff0 2020-04-02T23:46:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b000bfe0 con 0x7f40b0002fc0 2020-04-02T23:46:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169976352 0 0) 0x7f40b000bfe0 con 0x7f40b0002fc0 2020-04-02T23:46:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b000c250 con 0x7f40b0002fc0 2020-04-02T23:46:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336749517 0 0) 0x7f40b000ade0 con 0x7f40b0006ff0 2020-04-02T23:46:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b000bfe0 con 0x7f40b0006ff0 2020-04-02T23:46:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1836298183 0 0) 0x7f40b000c250 con 0x7f40b0002fc0 2020-04-02T23:46:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f40b000ade0 con 0x7f40b0002fc0 2020-04-02T23:46:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.690+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f40bc0012f0 con 0x7f40b0002fc0 2020-04-02T23:46:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 >> v1:172.21.15.82:6789/0 conn(0x7f40b0002fc0 legacy=0x7f40b00056a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 >> v1:172.21.15.50:6789/0 conn(0x7f40b0006ff0 legacy=0x7f40b00094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b000cc30 0x7f40b000af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 0x7f40b0013520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b000bd40 con 0x7f40b000cc30 2020-04-02T23:46:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0013980 con 0x7f40b000b3d0 2020-04-02T23:46:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0013ac0 con 0x7f40cc0a0330 2020-04-02T23:46:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40cb59e700 1 -- 172.21.15.82:0/3961189884 reap_dead start 2020-04-02T23:46:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40cad9d700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b000cc30 0x7f40b000af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40cb59e700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 0x7f40b0013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 -- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 msgr2=0x7f40b0013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 0x7f40b0013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 -- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b000cc30 msgr2=0x7f40b000af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b000cc30 0x7f40b000af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b000d2a0 con 0x7f40b000b3d0 2020-04-02T23:46:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc064150 con 0x7f40b000b3d0 2020-04-02T23:46:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc144860 con 0x7f40b000b3d0 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b40056c0 con 0x7f40b000b3d0 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4005820 con 0x7f40b000b3d0 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.691+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b4005b80 con 0x7f40b000b3d0 2020-04-02T23:46:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.692+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.692+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.692+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 360+0+0 (secure 0 0 0) 0x7f40b400a250 con 0x7f40b000b3d0 2020-04-02T23:46:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.692+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f40b400ab70 con 0x7f40b000b3d0 2020-04-02T23:46:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.692+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc061a30 con 0x7f40b000b3d0 2020-04-02T23:46:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.696+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.696+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f40b400a710 con 0x7f40b000b3d0 2020-04-02T23:46:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.772+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f40cc056c50 con 0x7f40b000b3d0 2020-04-02T23:46:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.779+0000 7f40c3fff700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.779+0000 7f40c37fe700 1 -- 172.21.15.82:0/3961189884 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f40b4007160 con 0x7f40b000b3d0 2020-04-02T23:46:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 msgr2=0x7f40b000b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f40b4002c40 tx=0x7f40cc0692b0).stop 2020-04-02T23:46:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 shutdown_connections 2020-04-02T23:46:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b000b3d0 0x7f40b000b7b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b000cc30 0x7f40b000af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 --2- 172.21.15.82:0/3961189884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40cc0a0330 0x7f40b0013520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 >> 172.21.15.82:0/3961189884 conn(0x7f40cc0aad00 msgr2=0x7f40cc0ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:39.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 shutdown_connections 2020-04-02T23:46:39.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:39.780+0000 7f40d0b6f700 1 -- 172.21.15.82:0/3961189884 wait complete. 2020-04-02T23:46:39.784 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2020-04-02T23:46:39.792 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-02T23:46:39.792 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:39.806 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:39.861 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.PSAeW3iaAf 2020-04-02T23:46:39.861 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:39.914 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.PSAeW3iaAf 2020-04-02T23:46:39.986 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.039 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.PSAeW3iaAf 2020-04-02T23:46:40.166 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.PSAeW3iaAf is 37B 2020-04-02T23:46:40.213 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.229 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.PSAeW3iaAf 2020-04-02T23:46:40.281 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.334 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:40.389 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.bL56rGEGOh 2020-04-02T23:46:40.389 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.453 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.bL56rGEGOh 2020-04-02T23:46:40.533 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.586 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.bL56rGEGOh 2020-04-02T23:46:40.715 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.bL56rGEGOh is 37B 2020-04-02T23:46:40.763 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.777 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.bL56rGEGOh 2020-04-02T23:46:40.831 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.884 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:40.939 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.xfJ534X9V3 2020-04-02T23:46:40.939 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:40.992 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.xfJ534X9V3 2020-04-02T23:46:41.064 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:41.118 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.xfJ534X9V3 2020-04-02T23:46:41.247 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.xfJ534X9V3 is 37B 2020-04-02T23:46:41.294 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:41.308 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.xfJ534X9V3 2020-04-02T23:46:41.364 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:41.418 INFO:teuthology.orchestra.run.smithi050:> mktemp 2020-04-02T23:46:41.473 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.NRQsxJzycK 2020-04-02T23:46:41.473 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:41.530 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.NRQsxJzycK 2020-04-02T23:46:41.600 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:41.653 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.NRQsxJzycK 2020-04-02T23:46:41.784 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.NRQsxJzycK is 37B 2020-04-02T23:46:41.831 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:41.845 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.NRQsxJzycK 2020-04-02T23:46:41.900 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:41.913 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:41.967 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.XdCDbe6QQf 2020-04-02T23:46:41.967 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.020 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.XdCDbe6QQf 2020-04-02T23:46:42.089 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.143 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.XdCDbe6QQf 2020-04-02T23:46:42.269 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.XdCDbe6QQf is 37B 2020-04-02T23:46:42.319 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.337 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.XdCDbe6QQf 2020-04-02T23:46:42.391 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.444 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:42.498 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.KgmBHreHw8 2020-04-02T23:46:42.498 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.551 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.KgmBHreHw8 2020-04-02T23:46:42.620 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.673 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.KgmBHreHw8 2020-04-02T23:46:42.797 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.KgmBHreHw8 is 37B 2020-04-02T23:46:42.846 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.859 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.KgmBHreHw8 2020-04-02T23:46:42.912 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:42.965 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:43.018 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.gSKmdMljRl 2020-04-02T23:46:43.018 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:43.070 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.gSKmdMljRl 2020-04-02T23:46:43.137 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:43.191 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.gSKmdMljRl 2020-04-02T23:46:43.314 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.gSKmdMljRl is 37B 2020-04-02T23:46:43.364 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:43.378 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.gSKmdMljRl 2020-04-02T23:46:43.431 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:43.484 INFO:teuthology.orchestra.run.smithi082:> mktemp 2020-04-02T23:46:43.537 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.Nu96FyjcKj 2020-04-02T23:46:43.538 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:43.590 INFO:teuthology.orchestra.run.smithi082:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.Nu96FyjcKj 2020-04-02T23:46:43.658 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:43.710 INFO:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.Nu96FyjcKj 2020-04-02T23:46:43.834 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.Nu96FyjcKj is 37B 2020-04-02T23:46:43.882 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:43.895 INFO:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.Nu96FyjcKj 2020-04-02T23:46:43.948 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:44.002 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new a2217a33-18df-4a82-9499-c9325111dea0 0 2020-04-02T23:46:44.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.143+0000 7fa563328700 1 Processor -- start 2020-04-02T23:46:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.144+0000 7fa563328700 1 -- start start 2020-04-02T23:46:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.144+0000 7fa563328700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa55c0a6e80 0x7fa55c05b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.144+0000 7fa563328700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.144+0000 7fa563328700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0a4bd0 con 0x7fa55c080100 2020-04-02T23:46:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.144+0000 7fa563328700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0605c0 con 0x7fa55c0a6e80 2020-04-02T23:46:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.144+0000 7fa563328700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0a33d0 con 0x7fa55c05b470 2020-04-02T23:46:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5618c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa55c0a6e80 0x7fa55c05b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:49164/0 (socket says 172.21.15.82:49164) 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 -- 172.21.15.82:0/4250535105 learned_addr learned my addr 172.21.15.82:0/4250535105 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 -- 172.21.15.82:0/4250535105 >> v2:172.21.15.50:3300/0 conn(0x7fa55c0a6e80 msgr2=0x7fa55c05b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- 172.21.15.82:0/4250535105 >> v2:172.21.15.50:3300/0 conn(0x7fa55c0a6e80 0x7fa55c05b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 -- 172.21.15.82:0/4250535105 >> v1:172.21.15.50:6789/0 conn(0x7fa55c080100 legacy=0x7fa55c0a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 -- 172.21.15.82:0/4250535105 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0a3870 con 0x7fa55c05b470 2020-04-02T23:46:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5618c5700 1 --2- 172.21.15.82:0/4250535105 >> v2:172.21.15.50:3300/0 conn(0x7fa55c0a6e80 0x7fa55c05b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).ready entity=mon.2 client_cookie=1ebed4bb8a061389 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5608c3700 1 -- 172.21.15.82:0/4250535105 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c011670 con 0x7fa55c05b470 2020-04-02T23:46:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5610c4700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5608c3700 1 -- 172.21.15.82:0/4250535105 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c0117d0 con 0x7fa55c05b470 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa5608c3700 1 -- 172.21.15.82:0/4250535105 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c011bf0 con 0x7fa55c05b470 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa563328700 1 -- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 msgr2=0x7fa55c07fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.145+0000 7fa563328700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).stop 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.146+0000 7fa563328700 1 -- 172.21.15.82:0/4250535105 shutdown_connections 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.146+0000 7fa563328700 1 --2- 172.21.15.82:0/4250535105 >> v2:172.21.15.50:3300/0 conn(0x7fa55c0a6e80 0x7fa55c05b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.146+0000 7fa563328700 1 --2- 172.21.15.82:0/4250535105 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c05b470 0x7fa55c07fca0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.146+0000 7fa563328700 1 -- 172.21.15.82:0/4250535105 >> 172.21.15.82:0/4250535105 conn(0x7fa55c0aad00 msgr2=0x7fa55c0ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.146+0000 7fa563328700 1 -- 172.21.15.82:0/4250535105 shutdown_connections 2020-04-02T23:46:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.146+0000 7fa563328700 1 -- 172.21.15.82:0/4250535105 wait complete. 2020-04-02T23:46:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.147+0000 7fa563328700 1 Processor -- start 2020-04-02T23:46:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.147+0000 7fa563328700 1 -- start start 2020-04-02T23:46:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.147+0000 7fa563328700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.147+0000 7fa563328700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c062a40 con 0x7fa55c0a6e80 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.147+0000 7fa563328700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c062c70 con 0x7fa55c05b470 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.147+0000 7fa563328700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c09f060 con 0x7fa55c080100 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5618c5700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa55c05b470 0x7fa55c0a0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53512/0 (socket says 172.21.15.82:53512) 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5618c5700 1 -- 172.21.15.82:0/907926164 learned_addr learned my addr 172.21.15.82:0/907926164 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112114333 0 0) 0x7fa55c062c70 con 0x7fa55c05b470 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa544003230 con 0x7fa55c05b470 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872207553 0 0) 0x7fa55c062a40 con 0x7fa55c0a6e80 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa55c062c70 con 0x7fa55c0a6e80 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 -- 172.21.15.82:0/907926164 >> v1:172.21.15.82:6789/0 conn(0x7fa55c05b470 legacy=0x7fa55c0a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 -- 172.21.15.82:0/907926164 >> v1:172.21.15.50:6789/0 conn(0x7fa55c0a6e80 legacy=0x7fa55c1231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 -- 172.21.15.82:0/907926164 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0a0060 con 0x7fa55c080100 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c011e60 con 0x7fa55c080100 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c007150 con 0x7fa55c080100 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c0074b0 con 0x7fa55c080100 2020-04-02T23:46:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c09f800 con 0x7fa55c080100 2020-04-02T23:46:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.148+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c125ed0 con 0x7fa55c080100 2020-04-02T23:46:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.149+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.149+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.149+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7fa54c0056c0 con 0x7fa55c080100 2020-04-02T23:46:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.149+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c0a01f0 con 0x7fa55c080100 2020-04-02T23:46:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.150+0000 7fa5527fc700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 0x7fa54404fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.150+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1130+0+0 (secure 0 0 0) 0x7fa54c060e60 con 0x7fa55c080100 2020-04-02T23:46:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.150+0000 7fa5618c5700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 0x7fa54404fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.150+0000 7fa5618c5700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 0x7fa54404fe10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5580032b0 tx=0x7fa558009730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.150+0000 7fa5618c5700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 0x7fa54404fe10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5580032b0 tx=0x7fa558009730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.150+0000 7fa5618c5700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 0x7fa54404fe10 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fa5580032b0 tx=0x7fa558009730).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.153+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.153+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa54c03c740 con 0x7fa55c080100 2020-04-02T23:46:44.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.307+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2217a33-18df-4a82-9499-c9325111dea0", "id": 0} v 0) v1 -- 0x7fa55c056c50 con 0x7fa55c080100 2020-04-02T23:46:44.313 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.311+0000 7fa5610c4700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.313 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.311+0000 7fa5527fc700 1 -- 172.21.15.82:0/907926164 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2217a33-18df-4a82-9499-c9325111dea0", "id": 0}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa54c03fd60 con 0x7fa55c080100 2020-04-02T23:46:44.313 INFO:teuthology.orchestra.run.smithi082.stdout:0 2020-04-02T23:46:44.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 msgr2=0x7fa54404fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 0x7fa54404fe10 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fa5580032b0 tx=0x7fa558009730).stop 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 msgr2=0x7fa55c09ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fa54c002f30 tx=0x7fa54c007a40).stop 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 shutdown_connections 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa54404d950 0x7fa54404fe10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 --2- 172.21.15.82:0/907926164 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa55c080100 0x7fa55c09ec00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 >> 172.21.15.82:0/907926164 conn(0x7fa55c0aad00 msgr2=0x7fa55c0ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 shutdown_connections 2020-04-02T23:46:44.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.312+0000 7fa563328700 1 -- 172.21.15.82:0/907926164 wait complete. 2020-04-02T23:46:44.324 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:44.337 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new e604193e-ce17-4f9c-aa8d-03e9bec4eeed 1 2020-04-02T23:46:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.479+0000 7f47bded2700 1 Processor -- start 2020-04-02T23:46:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.479+0000 7f47bded2700 1 -- start start 2020-04-02T23:46:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.479+0000 7f47bded2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47b80a6e80 0x7f47b805b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.479+0000 7f47bded2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b805b470 0x7f47b807fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.479+0000 7f47bded2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80a4bd0 con 0x7f47b8080100 2020-04-02T23:46:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.479+0000 7f47bded2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b80605c0 con 0x7f47b80a6e80 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.479+0000 7f47bded2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80a33d0 con 0x7f47b805b470 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47b80a6e80 0x7f47b805b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47b80a6e80 0x7f47b805b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53472/0 (socket says 172.21.15.82:53472) 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 -- 172.21.15.82:0/3351896195 learned_addr learned my addr 172.21.15.82:0/3351896195 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47affff700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b805b470 0x7f47b807fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 -- 172.21.15.82:0/3351896195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b805b470 msgr2=0x7f47b807fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b805b470 0x7f47b807fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 -- 172.21.15.82:0/3351896195 >> v1:172.21.15.50:6789/0 conn(0x7f47b8080100 legacy=0x7f47b80a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 -- 172.21.15.82:0/3351896195 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80a3870 con 0x7f47b80a6e80 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- 172.21.15.82:0/3351896195 >> v2:172.21.15.82:3300/0 conn(0x7f47b80a6e80 0x7f47b805b010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47b80a3750 tx=0x7f47a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- 172.21.15.82:0/3351896195 >> v2:172.21.15.82:3300/0 conn(0x7f47b80a6e80 0x7f47b805b010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47b80a3750 tx=0x7f47a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b80a6e80 0x7f47b805b010 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f47b80a3750 tx=0x7f47a8007a40).ready entity=mon.1 client_cookie=bf233837c5f5b970 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b80a6e80 0x7f47b805b010 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f47b80a3750 tx=0x7f47a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b80a6e80 0x7f47b805b010 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f47b80a3750 tx=0x7f47a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b77fe700 1 -- 172.21.15.82:0/3351896195 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a80116e0 con 0x7f47b80a6e80 2020-04-02T23:46:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b7fff700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b80a6e80 0x7f47b805b010 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f47b80a3750 tx=0x7f47a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b77fe700 1 -- 172.21.15.82:0/3351896195 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8011840 con 0x7f47b80a6e80 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47b77fe700 1 -- 172.21.15.82:0/3351896195 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a8011c60 con 0x7f47b80a6e80 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47bded2700 1 -- 172.21.15.82:0/3351896195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b80a6e80 msgr2=0x7f47b805b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.480+0000 7f47bded2700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b80a6e80 0x7f47b805b010 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f47b80a3750 tx=0x7f47a8007a40).stop 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.481+0000 7f47bded2700 1 -- 172.21.15.82:0/3351896195 shutdown_connections 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.481+0000 7f47bded2700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b80a6e80 0x7f47b805b010 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.481+0000 7f47bded2700 1 --2- 172.21.15.82:0/3351896195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b805b470 0x7f47b807fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.481+0000 7f47bded2700 1 -- 172.21.15.82:0/3351896195 >> 172.21.15.82:0/3351896195 conn(0x7f47b80aad00 msgr2=0x7f47b80ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.481+0000 7f47bded2700 1 -- 172.21.15.82:0/3351896195 shutdown_connections 2020-04-02T23:46:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.481+0000 7f47bded2700 1 -- 172.21.15.82:0/3351896195 wait complete. 2020-04-02T23:46:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.482+0000 7f47bded2700 1 Processor -- start 2020-04-02T23:46:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.482+0000 7f47bded2700 1 -- start start 2020-04-02T23:46:44.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.482+0000 7f47bded2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:44.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.482+0000 7f47bded2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47b80a6e80 0x7f47b8062620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:44.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.482+0000 7f47bded2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b8061b30 con 0x7f47b805b470 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.482+0000 7f47bded2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b8061dd0 con 0x7f47b80a6e80 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.482+0000 7f47bded2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8062070 con 0x7f47b8080100 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47bcc70700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47b80a6e80 0x7f47b8062620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:49186/0 (socket says 172.21.15.82:49186) 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 -- 172.21.15.82:0/2406180172 learned_addr learned my addr 172.21.15.82:0/2406180172 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 -- 172.21.15.82:0/2406180172 >> v2:172.21.15.50:3300/0 conn(0x7f47b80a6e80 msgr2=0x7f47b8062620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> v2:172.21.15.50:3300/0 conn(0x7f47b80a6e80 0x7f47b8062620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 -- 172.21.15.82:0/2406180172 >> v1:172.21.15.50:6789/0 conn(0x7f47b805b470 legacy=0x7f47b81233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 -- 172.21.15.82:0/2406180172 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8123af0 con 0x7f47b8080100 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148760622 0 0) 0x7f47b8061b30 con 0x7f47b805b470 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47bcc70700 1 --2- 172.21.15.82:0/2406180172 >> v2:172.21.15.50:3300/0 conn(0x7f47b80a6e80 0x7f47b8062620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a000a350 con 0x7f47b8080100 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000a4f0 con 0x7f47b8080100 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b805b0a0 con 0x7f47b8080100 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a000a8d0 con 0x7f47b8080100 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.483+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b8125b60 con 0x7f47b8080100 2020-04-02T23:46:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.484+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.484+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b8061970 con 0x7f47b8080100 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.484+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f47a000ab40 con 0x7f47b8080100 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.484+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.485+0000 7f47b57fa700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 0x7f479c04f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.485+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1269+0+0 (secure 0 0 0) 0x7f47a0060b00 con 0x7f47b8080100 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.485+0000 7f47b7fff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 0x7f479c04f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.485+0000 7f47b7fff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 0x7f479c04f870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47a8000b80 tx=0x7f47a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.485+0000 7f47b7fff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 0x7f479c04f870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47a8000b80 tx=0x7f47a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.485+0000 7f47b7fff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 0x7f479c04f870 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f47a8000b80 tx=0x7f47a8007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.488+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.488+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f47a003c3a0 con 0x7f47b8080100 2020-04-02T23:46:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.641+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e604193e-ce17-4f9c-aa8d-03e9bec4eeed", "id": 1} v 0) v1 -- 0x7f47b8056c50 con 0x7f47b8080100 2020-04-02T23:46:44.647 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.645+0000 7f47affff700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.647 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.645+0000 7f47b57fa700 1 -- 172.21.15.82:0/2406180172 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e604193e-ce17-4f9c-aa8d-03e9bec4eeed", "id": 1}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47a003f9c0 con 0x7f47b8080100 2020-04-02T23:46:44.648 INFO:teuthology.orchestra.run.smithi082.stdout:1 2020-04-02T23:46:44.649 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 msgr2=0x7f479c04f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.649 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 0x7f479c04f870 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f47a8000b80 tx=0x7f47a8007a40).stop 2020-04-02T23:46:44.649 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 msgr2=0x7f47b8064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.649 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f47a0002f30 tx=0x7f47a0010a40).stop 2020-04-02T23:46:44.649 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 shutdown_connections 2020-04-02T23:46:44.650 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f479c04d3b0 0x7f479c04f870 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.650 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 --2- 172.21.15.82:0/2406180172 >> v2:172.21.15.50:3300/0 conn(0x7f47b80a6e80 0x7f47b8062620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.650 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 --2- 172.21.15.82:0/2406180172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47b8080100 0x7f47b8064c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.650 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 >> 172.21.15.82:0/2406180172 conn(0x7f47b80aad00 msgr2=0x7f47b80ab0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:44.650 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 shutdown_connections 2020-04-02T23:46:44.650 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.647+0000 7f47bded2700 1 -- 172.21.15.82:0/2406180172 wait complete. 2020-04-02T23:46:44.658 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:44.671 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b 2 2020-04-02T23:46:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.812+0000 7f218bdc6700 1 Processor -- start 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.812+0000 7f218bdc6700 1 -- start start 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f218bdc6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f218bdc6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840a4bd0 con 0x7f21840803b0 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f218bdc6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840605c0 con 0x7f218405b470 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f218bdc6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2184080820 con 0x7f21840a6e80 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f2189b62700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f218405b470 0x7f218407fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53536/0 (socket says 172.21.15.82:53536) 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f2189b62700 1 -- 172.21.15.82:0/3620597700 learned_addr learned my addr 172.21.15.82:0/3620597700 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f218a363700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369835595 0 0) 0x7f21840605c0 con 0x7f218405b470 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.813+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2170003230 con 0x7f218405b470 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301797521 0 0) 0x7f21840a4bd0 con 0x7f21840803b0 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21840605c0 con 0x7f21840803b0 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1037696758 0 0) 0x7f2170003230 con 0x7f218405b470 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 -- 172.21.15.82:0/3620597700 >> v1:172.21.15.82:6789/0 conn(0x7f218405b470 legacy=0x7f218407fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 -- 172.21.15.82:0/3620597700 >> v1:172.21.15.50:6789/0 conn(0x7f21840803b0 legacy=0x7f218414fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 -- 172.21.15.82:0/3620597700 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840a33d0 con 0x7f21840a6e80 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21740010d0 tx=0x7f21800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21740010d0 tx=0x7f21800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f21740010d0 tx=0x7f21800088e0).ready entity=mon.2 client_cookie=e0ac6d302dbad878 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f21740010d0 tx=0x7f21800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21740016d0 con 0x7f21840a6e80 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f21740010d0 tx=0x7f21800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218a363700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f21740010d0 tx=0x7f21800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180011210 con 0x7f21840a6e80 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f2189361700 1 -- 172.21.15.82:0/3620597700 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2180011570 con 0x7f21840a6e80 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218bdc6700 1 -- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 msgr2=0x7f218405b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.814+0000 7f218bdc6700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f21740010d0 tx=0x7f21800088e0).stop 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.815+0000 7f218bdc6700 1 -- 172.21.15.82:0/3620597700 shutdown_connections 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.815+0000 7f218bdc6700 1 --2- 172.21.15.82:0/3620597700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21840a6e80 0x7f218405b010 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.815+0000 7f218bdc6700 1 -- 172.21.15.82:0/3620597700 >> 172.21.15.82:0/3620597700 conn(0x7f21840aad00 msgr2=0x7f21840ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.815+0000 7f218bdc6700 1 -- 172.21.15.82:0/3620597700 shutdown_connections 2020-04-02T23:46:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.815+0000 7f218bdc6700 1 -- 172.21.15.82:0/3620597700 wait complete. 2020-04-02T23:46:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218bdc6700 1 Processor -- start 2020-04-02T23:46:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218bdc6700 1 -- start start 2020-04-02T23:46:44.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218bdc6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21840803b0 0x7f21841387e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:44.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218bdc6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2184138d60 con 0x7f218405b470 2020-04-02T23:46:44.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218bdc6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2184139000 con 0x7f21840a6e80 2020-04-02T23:46:44.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218bdc6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21841392a0 con 0x7f21840803b0 2020-04-02T23:46:44.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f2189b62700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21840803b0 0x7f21841387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218ab64700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f21840a6e80 0x7f2184129ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53546/0 (socket says 172.21.15.82:53546) 2020-04-02T23:46:44.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.816+0000 7f218ab64700 1 -- 172.21.15.82:0/2819681300 learned_addr learned my addr 172.21.15.82:0/2819681300 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 -- 172.21.15.82:0/2819681300 >> v1:172.21.15.82:6789/0 conn(0x7f21840a6e80 legacy=0x7f2184129ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 -- 172.21.15.82:0/2819681300 >> v1:172.21.15.50:6789/0 conn(0x7f218405b470 legacy=0x7f21841366e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853564375 0 0) 0x7f2184139000 con 0x7f21840a6e80 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 -- 172.21.15.82:0/2819681300 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840a43c0 con 0x7f21840803b0 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> v2:172.21.15.82:3300/0 conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> v2:172.21.15.82:3300/0 conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2174012a10 con 0x7f21840803b0 2020-04-02T23:46:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174012b70 con 0x7f21840803b0 2020-04-02T23:46:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21840a65b0 con 0x7f21840803b0 2020-04-02T23:46:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217400c570 con 0x7f21840803b0 2020-04-02T23:46:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218412a700 con 0x7f21840803b0 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.817+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f217400c6d0 con 0x7f21840803b0 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184139660 con 0x7f21840803b0 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f217affd700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 0x7f216c04f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1384+0+0 (secure 0 0 0) 0x7f2174060ee0 con 0x7f21840803b0 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f218a363700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 0x7f216c04f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f218a363700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 0x7f216c04f820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21840a64e0 tx=0x7f218406ac40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f218a363700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 0x7f216c04f820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21840a64e0 tx=0x7f218406ac40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.818+0000 7f218a363700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 0x7f216c04f820 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f21840a64e0 tx=0x7f218406ac40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.822+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.822+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f217403c780 con 0x7f21840803b0 2020-04-02T23:46:44.975 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.973+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b", "id": 2} v 0) v1 -- 0x7f2184056c50 con 0x7f21840803b0 2020-04-02T23:46:44.979 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.977+0000 7f2189b62700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:44.979 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.977+0000 7f217affd700 1 -- 172.21.15.82:0/2819681300 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b", "id": 2}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f217403fda0 con 0x7f21840803b0 2020-04-02T23:46:44.979 INFO:teuthology.orchestra.run.smithi082.stdout:2 2020-04-02T23:46:44.981 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 msgr2=0x7f216c04f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.981 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 0x7f216c04f820 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f21840a64e0 tx=0x7f218406ac40).stop 2020-04-02T23:46:44.981 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 msgr2=0x7f21841387e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:44.981 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f2174000fa0 tx=0x7f2174010cd0).stop 2020-04-02T23:46:44.982 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 shutdown_connections 2020-04-02T23:46:44.982 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f216c04d360 0x7f216c04f820 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.982 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 --2- 172.21.15.82:0/2819681300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21840803b0 0x7f21841387e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:44.982 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 >> 172.21.15.82:0/2819681300 conn(0x7f21840aad00 msgr2=0x7f21840ab0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:44.982 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 shutdown_connections 2020-04-02T23:46:44.982 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:44.979+0000 7f218bdc6700 1 -- 172.21.15.82:0/2819681300 wait complete. 2020-04-02T23:46:44.990 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:45.003 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 295c5ad2-22bd-4fc6-8c27-898b1cf61412 3 2020-04-02T23:46:45.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.144+0000 7f06754dc700 1 Processor -- start 2020-04-02T23:46:45.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.144+0000 7f06754dc700 1 -- start start 2020-04-02T23:46:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f06754dc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f067005b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f06754dc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06700803b0 0x7f067014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f06754dc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06700a4bd0 con 0x7f067005b470 2020-04-02T23:46:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f06754dc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700605c0 con 0x7f06700803b0 2020-04-02T23:46:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f06754dc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700a33d0 con 0x7f06700a6e80 2020-04-02T23:46:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f066f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f067005b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f066f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f067005b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53500/0 (socket says 172.21.15.82:53500) 2020-04-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f066f7fe700 1 -- 172.21.15.82:0/1566322228 learned_addr learned my addr 172.21.15.82:0/1566322228 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f066ffff700 1 --2- 172.21.15.82:0/1566322228 >> v2:172.21.15.50:3300/0 conn(0x7f06700803b0 0x7f067014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f066f7fe700 1 -- 172.21.15.82:0/1566322228 >> v2:172.21.15.50:3300/0 conn(0x7f06700803b0 msgr2=0x7f067014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.145+0000 7f066f7fe700 1 --2- 172.21.15.82:0/1566322228 >> v2:172.21.15.50:3300/0 conn(0x7f06700803b0 0x7f067014fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 -- 172.21.15.82:0/1566322228 >> v1:172.21.15.50:6789/0 conn(0x7f067005b470 legacy=0x7f067007fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 -- 172.21.15.82:0/1566322228 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700a3870 con 0x7f06700a6e80 2020-04-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 --2- 172.21.15.82:0/1566322228 >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f067005b010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06700a2710 tx=0x7f0660007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 --2- 172.21.15.82:0/1566322228 >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f067005b010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06700a2710 tx=0x7f0660007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 --2- 172.21.15.82:0/1566322228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f067005b010 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f06700a2710 tx=0x7f0660007a40).ready entity=mon.1 client_cookie=36f7b277a3ed78b9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 --2- 172.21.15.82:0/1566322228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f067005b010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f06700a2710 tx=0x7f0660007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 --2- 172.21.15.82:0/1566322228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f067005b010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f06700a2710 tx=0x7f0660007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066effd700 1 -- 172.21.15.82:0/1566322228 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06600116e0 con 0x7f06700a6e80 2020-04-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066f7fe700 1 --2- 172.21.15.82:0/1566322228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f067005b010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f06700a2710 tx=0x7f0660007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066effd700 1 -- 172.21.15.82:0/1566322228 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0660011840 con 0x7f06700a6e80 2020-04-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f066effd700 1 -- 172.21.15.82:0/1566322228 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0660011c20 con 0x7f06700a6e80 2020-04-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 -- 172.21.15.82:0/1566322228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 msgr2=0x7f067005b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 --2- 172.21.15.82:0/1566322228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f067005b010 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f06700a2710 tx=0x7f0660007a40).stop 2020-04-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 -- 172.21.15.82:0/1566322228 shutdown_connections 2020-04-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 --2- 172.21.15.82:0/1566322228 >> v2:172.21.15.50:3300/0 conn(0x7f06700803b0 0x7f067014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 --2- 172.21.15.82:0/1566322228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f067005b010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 -- 172.21.15.82:0/1566322228 >> 172.21.15.82:0/1566322228 conn(0x7f06700aad00 msgr2=0x7f06700ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 -- 172.21.15.82:0/1566322228 shutdown_connections 2020-04-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.146+0000 7f06754dc700 1 -- 172.21.15.82:0/1566322228 wait complete. 2020-04-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.147+0000 7f06754dc700 1 Processor -- start 2020-04-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.147+0000 7f06754dc700 1 -- start start 2020-04-02T23:46:45.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f06754dc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f0670065960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f06754dc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0670063b30 con 0x7f06700803b0 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f06754dc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06700a5ed0 con 0x7f067005b470 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f06754dc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067014fbc0 con 0x7f06700a6e80 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f0670065960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f067005b470 0x7f06700a8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53554/0 (socket says 172.21.15.82:53554) 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066f7fe700 1 -- 172.21.15.82:0/366592185 learned_addr learned my addr 172.21.15.82:0/366592185 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066ffff700 1 -- 172.21.15.82:0/366592185 >> v1:172.21.15.82:6789/0 conn(0x7f067005b470 legacy=0x7f06700a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066ffff700 1 -- 172.21.15.82:0/366592185 >> v1:172.21.15.50:6789/0 conn(0x7f06700803b0 legacy=0x7f06700a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066ffff700 1 -- 172.21.15.82:0/366592185 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700a9a00 con 0x7f06700a6e80 2020-04-02T23:46:45.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589124629 0 0) 0x7f06700a5ed0 con 0x7f067005b470 2020-04-02T23:46:45.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> v2:172.21.15.82:3300/0 conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.148+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0668007350 con 0x7f06700a6e80 2020-04-02T23:46:45.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06680074f0 con 0x7f06700a6e80 2020-04-02T23:46:45.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06680078d0 con 0x7f06700a6e80 2020-04-02T23:46:45.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0670064ad0 con 0x7f06700a6e80 2020-04-02T23:46:45.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0670063350 con 0x7f06700a6e80 2020-04-02T23:46:45.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.149+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06700636e0 con 0x7f06700a6e80 2020-04-02T23:46:45.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f0668012370 con 0x7f06700a6e80 2020-04-02T23:46:45.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066cff9700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 0x7f065404f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1499+0+0 (secure 0 0 0) 0x7f0668061450 con 0x7f06700a6e80 2020-04-02T23:46:45.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066f7fe700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 0x7f065404f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066f7fe700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 0x7f065404f840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0660008320 tx=0x7f0660007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066f7fe700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 0x7f065404f840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0660008320 tx=0x7f0660007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.150+0000 7f066f7fe700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 0x7f065404f840 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f0660008320 tx=0x7f0660007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.153+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.153+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f066803cc30 con 0x7f06700a6e80 2020-04-02T23:46:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.309+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "295c5ad2-22bd-4fc6-8c27-898b1cf61412", "id": 3} v 0) v1 -- 0x7f0670056c50 con 0x7f06700a6e80 2020-04-02T23:46:45.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.312+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.313+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f066803d000 con 0x7f06700a6e80 2020-04-02T23:46:45.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.316+0000 7f066ffff700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.316+0000 7f066cff9700 1 -- 172.21.15.82:0/366592185 <== mon.1 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "295c5ad2-22bd-4fc6-8c27-898b1cf61412", "id": 3}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f066801a250 con 0x7f06700a6e80 2020-04-02T23:46:45.318 INFO:teuthology.orchestra.run.smithi082.stdout:3 2020-04-02T23:46:45.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 msgr2=0x7f065404f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 0x7f065404f840 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f0660008320 tx=0x7f0660007a40).stop 2020-04-02T23:46:45.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 msgr2=0x7f0670065960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f06700a68a0 tx=0x7f0668010d10).stop 2020-04-02T23:46:45.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 shutdown_connections 2020-04-02T23:46:45.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f065404d380 0x7f065404f840 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 --2- 172.21.15.82:0/366592185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06700a6e80 0x7f0670065960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 >> 172.21.15.82:0/366592185 conn(0x7f06700aad00 msgr2=0x7f06700a1150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:45.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 shutdown_connections 2020-04-02T23:46:45.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.318+0000 7f06754dc700 1 -- 172.21.15.82:0/366592185 wait complete. 2020-04-02T23:46:45.329 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:45.343 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 31998e05-06a4-4dbe-b0e5-6d4c4ab7787b 4 2020-04-02T23:46:45.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.484+0000 7f8ab61cf700 1 Processor -- start 2020-04-02T23:46:45.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.484+0000 7f8ab61cf700 1 -- start start 2020-04-02T23:46:45.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab61cf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0080130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:45.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab61cf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0080590 0x7f8ab014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:45.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab61cf700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00a4bd0 con 0x7f8ab00a6e80 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab61cf700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00605c0 con 0x7f8ab007fca0 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab61cf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00a33d0 con 0x7f8ab0080590 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0080130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aaffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8ab00a6e80 0x7f8ab005b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53560/0 (socket says 172.21.15.82:53560) 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aaffff700 1 -- 172.21.15.82:0/99143225 learned_addr learned my addr 172.21.15.82:0/99143225 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab4f6d700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0080590 0x7f8ab014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 -- 172.21.15.82:0/99143225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0080590 msgr2=0x7f8ab014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0080590 0x7f8ab014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 -- 172.21.15.82:0/99143225 >> v1:172.21.15.82:6789/0 conn(0x7f8ab00a6e80 legacy=0x7f8ab005b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 -- 172.21.15.82:0/99143225 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab005b720 con 0x7f8ab007fca0 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aaf7fe700 1 -- 172.21.15.82:0/99143225 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484187290 0 0) 0x7f8ab00a4bd0 con 0x7f8ab00a6e80 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab4f6d700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0080590 0x7f8ab014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/99143225 >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0080130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a98002f30 tx=0x7f8a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/99143225 >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0080130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a98002f30 tx=0x7f8a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0080130 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).ready entity=mon.1 client_cookie=5258411976d438ef server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0080130 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aaf7fe700 1 -- 172.21.15.82:0/99143225 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a98011470 con 0x7f8ab007fca0 2020-04-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0080130 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0080130 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aaf7fe700 1 -- 172.21.15.82:0/99143225 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a980115d0 con 0x7f8ab007fca0 2020-04-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8aaf7fe700 1 -- 172.21.15.82:0/99143225 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a980119b0 con 0x7f8ab007fca0 2020-04-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab61cf700 1 -- 172.21.15.82:0/99143225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 msgr2=0x7f8ab0080130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.485+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0080130 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).stop 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.486+0000 7f8ab61cf700 1 -- 172.21.15.82:0/99143225 shutdown_connections 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.486+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0080590 0x7f8ab014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.486+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/99143225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0080130 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.486+0000 7f8ab61cf700 1 -- 172.21.15.82:0/99143225 >> 172.21.15.82:0/99143225 conn(0x7f8ab00aad00 msgr2=0x7f8ab00ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.486+0000 7f8ab61cf700 1 -- 172.21.15.82:0/99143225 shutdown_connections 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.486+0000 7f8ab61cf700 1 -- 172.21.15.82:0/99143225 wait complete. 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 Processor -- start 2020-04-02T23:46:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 -- start start 2020-04-02T23:46:45.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0133950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ab00a6e80 0x7f8ab0062420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0062880 0x7f8ab00a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab0133020 con 0x7f8ab00a6e80 2020-04-02T23:46:45.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab0133210 con 0x7f8ab007fca0 2020-04-02T23:46:45.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.487+0000 7f8ab61cf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab01334b0 con 0x7f8ab0062880 2020-04-02T23:46:45.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0133950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53514/0 (socket says 172.21.15.82:53514) 2020-04-02T23:46:45.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 -- 172.21.15.82:0/2058081824 learned_addr learned my addr 172.21.15.82:0/2058081824 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:45.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8ab4f6d700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0062880 0x7f8ab00a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/2058081824 >> v2:172.21.15.50:3300/0 conn(0x7f8ab00a6e80 0x7f8ab0062420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 -- 172.21.15.82:0/2058081824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0062880 msgr2=0x7f8ab00a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0062880 0x7f8ab00a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 -- 172.21.15.82:0/2058081824 >> v2:172.21.15.50:3300/0 conn(0x7f8ab00a6e80 msgr2=0x7f8ab0062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> v2:172.21.15.50:3300/0 conn(0x7f8ab00a6e80 0x7f8ab0062420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 -- 172.21.15.82:0/2058081824 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab01289e0 con 0x7f8ab007fca0 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/2058081824 >> v2:172.21.15.50:3300/0 conn(0x7f8ab00a6e80 0x7f8ab0062420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> v2:172.21.15.82:3300/0 conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aad7fa700 1 -- 172.21.15.82:0/2058081824 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa0005ca0 con 0x7f8ab007fca0 2020-04-02T23:46:45.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aad7fa700 1 -- 172.21.15.82:0/2058081824 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0005e00 con 0x7f8ab007fca0 2020-04-02T23:46:45.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8aad7fa700 1 -- 172.21.15.82:0/2058081824 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa00122c0 con 0x7f8ab007fca0 2020-04-02T23:46:45.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab00a0d60 con 0x7f8ab007fca0 2020-04-02T23:46:45.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.488+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab0133f70 con 0x7f8ab007fca0 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8aad7fa700 1 -- 172.21.15.82:0/2058081824 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8aa0012420 con 0x7f8ab007fca0 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab0056c50 con 0x7f8ab007fca0 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8aad7fa700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 0x7f8a9404fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8aad7fa700 1 -- 172.21.15.82:0/2058081824 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1614+0+0 (secure 0 0 0) 0x7f8aa0061010 con 0x7f8ab007fca0 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 0x7f8a9404fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.489+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 0x7f8a9404fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.490+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 0x7f8a9404fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.490+0000 7f8aa7fff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 0x7f8a9404fb20 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.493+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.493+0000 7f8aad7fa700 1 -- 172.21.15.82:0/2058081824 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f8aa003c770 con 0x7f8ab007fca0 2020-04-02T23:46:45.647 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.645+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "31998e05-06a4-4dbe-b0e5-6d4c4ab7787b", "id": 4} v 0) v1 -- 0x7f8ab00675d0 con 0x7f8ab007fca0 2020-04-02T23:46:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.649+0000 7f8aaffff700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.649+0000 7f8aad7fa700 1 -- 172.21.15.82:0/2058081824 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31998e05-06a4-4dbe-b0e5-6d4c4ab7787b", "id": 4}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8aa003fd90 con 0x7f8ab007fca0 2020-04-02T23:46:45.652 INFO:teuthology.orchestra.run.smithi082.stdout:4 2020-04-02T23:46:45.653 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 msgr2=0x7f8a9404fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.653 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 0x7f8a9404fb20 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f8a98002f30 tx=0x7f8a98007a40).stop 2020-04-02T23:46:45.653 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 msgr2=0x7f8ab0133950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.654 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f8aa0000b80 tx=0x7f8aa0010a30).stop 2020-04-02T23:46:45.654 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 shutdown_connections 2020-04-02T23:46:45.654 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8a9404d660 0x7f8a9404fb20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.656 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ab0062880 0x7f8ab00a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.656 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/2058081824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab007fca0 0x7f8ab0133950 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.656 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 --2- 172.21.15.82:0/2058081824 >> v2:172.21.15.50:3300/0 conn(0x7f8ab00a6e80 0x7f8ab0062420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 >> 172.21.15.82:0/2058081824 conn(0x7f8ab00aad00 msgr2=0x7f8ab00aa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 shutdown_connections 2020-04-02T23:46:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.651+0000 7f8ab61cf700 1 -- 172.21.15.82:0/2058081824 wait complete. 2020-04-02T23:46:45.663 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:45.676 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 7119fccd-946f-459f-9043-0ed28fa226fe 5 2020-04-02T23:46:45.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.817+0000 7fa08759e700 1 Processor -- start 2020-04-02T23:46:45.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.817+0000 7fa08759e700 1 -- start start 2020-04-02T23:46:45.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.817+0000 7fa08759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0880a3ef0 0x7fa0880a8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:45.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.817+0000 7fa08759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0880a7b50 0x7fa08807fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:45.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.817+0000 7fa08759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0880a3820 con 0x7fa0880a42d0 2020-04-02T23:46:45.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.817+0000 7fa08759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880a7050 con 0x7fa0880a7b50 2020-04-02T23:46:45.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.817+0000 7fa08759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880a3a50 con 0x7fa0880a3ef0 2020-04-02T23:46:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0880a3ef0 0x7fa0880a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa08659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa0880a42d0 0x7fa0880a7440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53572/0 (socket says 172.21.15.82:53572) 2020-04-02T23:46:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa08659c700 1 -- 172.21.15.82:0/1961376762 learned_addr learned my addr 172.21.15.82:0/1961376762 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 -- 172.21.15.82:0/1961376762 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a7b50 msgr2=0x7fa08807fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa08ce18700 1 --2- 172.21.15.82:0/1961376762 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a7b50 0x7fa08807fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- 172.21.15.82:0/1961376762 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a7b50 0x7fa08807fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa085d9b700 1 -- 172.21.15.82:0/1961376762 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845590654 0 0) 0x7fa0880a3820 con 0x7fa0880a42d0 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 -- 172.21.15.82:0/1961376762 >> v1:172.21.15.82:6789/0 conn(0x7fa0880a42d0 legacy=0x7fa0880a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 -- 172.21.15.82:0/1961376762 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880675c0 con 0x7fa0880a3ef0 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa08ce18700 1 --2- 172.21.15.82:0/1961376762 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a7b50 0x7fa08807fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- 172.21.15.82:0/1961376762 >> v2:172.21.15.82:3300/0 conn(0x7fa0880a3ef0 0x7fa0880a8950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa078002f30 tx=0x7fa078007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- 172.21.15.82:0/1961376762 >> v2:172.21.15.82:3300/0 conn(0x7fa0880a3ef0 0x7fa0880a8950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa078002f30 tx=0x7fa078007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- 172.21.15.82:0/1961376762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0880a3ef0 0x7fa0880a8950 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fa078002f30 tx=0x7fa078007a40).ready entity=mon.1 client_cookie=17bec2da7ada7cab server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- 172.21.15.82:0/1961376762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0880a3ef0 0x7fa0880a8950 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fa078002f30 tx=0x7fa078007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa085d9b700 1 -- 172.21.15.82:0/1961376762 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa078011470 con 0x7fa0880a3ef0 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- 172.21.15.82:0/1961376762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0880a3ef0 0x7fa0880a8950 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fa078002f30 tx=0x7fa078007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa086d9d700 1 --2- 172.21.15.82:0/1961376762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0880a3ef0 0x7fa0880a8950 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fa078002f30 tx=0x7fa078007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa085d9b700 1 -- 172.21.15.82:0/1961376762 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0780115d0 con 0x7fa0880a3ef0 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa085d9b700 1 -- 172.21.15.82:0/1961376762 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa078011970 con 0x7fa0880a3ef0 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa08759e700 1 -- 172.21.15.82:0/1961376762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0880a3ef0 msgr2=0x7fa0880a8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.818+0000 7fa08759e700 1 --2- 172.21.15.82:0/1961376762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0880a3ef0 0x7fa0880a8950 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fa078002f30 tx=0x7fa078007a40).stop 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.819+0000 7fa08759e700 1 -- 172.21.15.82:0/1961376762 shutdown_connections 2020-04-02T23:46:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.819+0000 7fa08759e700 1 --2- 172.21.15.82:0/1961376762 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a7b50 0x7fa08807fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.819+0000 7fa08759e700 1 --2- 172.21.15.82:0/1961376762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0880a3ef0 0x7fa0880a8950 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.819+0000 7fa08759e700 1 -- 172.21.15.82:0/1961376762 >> 172.21.15.82:0/1961376762 conn(0x7fa08805efb0 msgr2=0x7fa08805f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.819+0000 7fa08759e700 1 -- 172.21.15.82:0/1961376762 shutdown_connections 2020-04-02T23:46:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.819+0000 7fa08759e700 1 -- 172.21.15.82:0/1961376762 wait complete. 2020-04-02T23:46:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08759e700 1 Processor -- start 2020-04-02T23:46:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08759e700 1 -- start start 2020-04-02T23:46:45.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0880a42d0 0x7fa0880a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa088128d90 con 0x7fa0880a3ef0 2020-04-02T23:46:45.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa088135480 con 0x7fa0880a7b50 2020-04-02T23:46:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa088135720 con 0x7fa0880a42d0 2020-04-02T23:46:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08ce18700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa0880a7b50 0x7fa0880a0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53582/0 (socket says 172.21.15.82:53582) 2020-04-02T23:46:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.820+0000 7fa08ce18700 1 -- 172.21.15.82:0/613740239 learned_addr learned my addr 172.21.15.82:0/613740239 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08659c700 1 --2- 172.21.15.82:0/613740239 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a42d0 0x7fa0880a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874233363 0 0) 0x7fa088135480 con 0x7fa0880a7b50 2020-04-02T23:46:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa06c003230 con 0x7fa0880a7b50 2020-04-02T23:46:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 708924964 0 0) 0x7fa06c003230 con 0x7fa0880a7b50 2020-04-02T23:46:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa088135480 con 0x7fa0880a7b50 2020-04-02T23:46:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fa080008510 con 0x7fa0880a7b50 2020-04-02T23:46:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a42d0 msgr2=0x7fa0880a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> v2:172.21.15.50:3300/0 conn(0x7fa0880a42d0 0x7fa0880a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 >> v1:172.21.15.82:6789/0 conn(0x7fa0880a7b50 legacy=0x7fa0880a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 >> v1:172.21.15.50:6789/0 conn(0x7fa0880a3ef0 legacy=0x7fa088131ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 0x7fa06c004930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004d90 0x7fa06c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088135720 con 0x7fa06c0044d0 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c005330 con 0x7fa06c0037f0 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c00bb80 con 0x7fa06c004d90 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08659c700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 0x7fa06c004930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08659c700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 msgr2=0x7fa06c004930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-04-02T23:46:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08659c700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 msgr2=0x7fa06c004930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-04-02T23:46:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004d90 0x7fa06c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08659c700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 0x7fa06c004930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08659c700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 0x7fa06c004930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:46:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004d90 msgr2=0x7fa06c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004d90 0x7fa06c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 msgr2=0x7fa06c004930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:46:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c0044d0 0x7fa06c004930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0881359c0 con 0x7fa06c0037f0 2020-04-02T23:46:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08ce18700 1 -- 172.21.15.82:0/613740239 reap_dead start 2020-04-02T23:46:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088135170 con 0x7fa06c0037f0 2020-04-02T23:46:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa088128c50 tx=0x7fa078007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa088135e60 con 0x7fa06c0037f0 2020-04-02T23:46:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa088128c50 tx=0x7fa078007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.821+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fa088128c50 tx=0x7fa078007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa086d9d700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 msgr2=0x7fa06c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa086d9d700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 msgr2=0x7fa06c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fa088128c50 tx=0x7fa078007a40).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fa088128c50 tx=0x7fa078007a40).stop 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 msgr2=0x7fa06c003bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c0037f0 0x7fa06c003bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004930 0x7fa06c009710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c009d30 0x7fa06c00a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c00b260 con 0x7fa06c009d30 2020-04-02T23:46:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c00b3d0 con 0x7fa06c00a7c0 2020-04-02T23:46:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c00b590 con 0x7fa06c004930 2020-04-02T23:46:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004930 0x7fa06c009710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08659c700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c009d30 0x7fa06c00a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004930 msgr2=0x7fa06c009710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004930 0x7fa06c009710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c009d30 msgr2=0x7fa06c00a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c009d30 0x7fa06c00a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) v3 -- 0x7fa06c003230 con 0x7fa06c00a7c0 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08000e5e0 con 0x7fa06c00a7c0 2020-04-02T23:46:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.822+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08000e740 con 0x7fa06c00a7c0 2020-04-02T23:46:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.823+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.823+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa060003340 con 0x7fa06c00a7c0 2020-04-02T23:46:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.823+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa08000e8b0 con 0x7fa06c00a7c0 2020-04-02T23:46:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.823+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.823+0000 7fa07f7fe700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 0x7fa06c0593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.823+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v2:172.21.15.82:3300/0 4 ==== osd_map(8..8 src has 1..8) v4 ==== 1729+0+0 (secure 0 0 0) 0x7fa080063780 con 0x7fa06c00a7c0 2020-04-02T23:46:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.823+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 0x7fa06c0593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.824+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 0x7fa06c0593f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa07800f330 tx=0x7fa088135300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.824+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 0x7fa06c0593f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa07800f330 tx=0x7fa088135300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.824+0000 7fa086d9d700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 0x7fa06c0593f0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fa07800f330 tx=0x7fa088135300).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:45.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.827+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.827+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v2:172.21.15.82:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa08003efc0 con 0x7fa06c00a7c0 2020-04-02T23:46:45.979 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.978+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7119fccd-946f-459f-9043-0ed28fa226fe", "id": 5} v 0) v1 -- 0x7fa060002220 con 0x7fa06c00a7c0 2020-04-02T23:46:45.983 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.981+0000 7fa08ce18700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:45.983 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.981+0000 7fa07f7fe700 1 -- 172.21.15.82:0/613740239 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7119fccd-946f-459f-9043-0ed28fa226fe", "id": 5}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0800425c0 con 0x7fa06c00a7c0 2020-04-02T23:46:45.984 INFO:teuthology.orchestra.run.smithi082.stdout:5 2020-04-02T23:46:45.985 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 msgr2=0x7fa06c0593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.985 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 0x7fa06c0593f0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fa07800f330 tx=0x7fa088135300).stop 2020-04-02T23:46:45.985 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 msgr2=0x7fa06c00ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fa0800082e0 tx=0x7fa0800137f0).stop 2020-04-02T23:46:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 shutdown_connections 2020-04-02T23:46:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa06c0037f0 0x7fa06c0593f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa06c00a7c0 0x7fa06c00ac40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c009d30 0x7fa06c00a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 --2- 172.21.15.82:0/613740239 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa06c004930 0x7fa06c009710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 >> 172.21.15.82:0/613740239 conn(0x7fa08805efb0 msgr2=0x7fa0880255b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:45.987 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 shutdown_connections 2020-04-02T23:46:45.987 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:45.983+0000 7fa08759e700 1 -- 172.21.15.82:0/613740239 wait complete. 2020-04-02T23:46:45.996 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:46.009 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new c6f6c1e1-951d-41de-86f8-d782b8879e72 6 2020-04-02T23:46:46.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.150+0000 7f8e43efe700 1 Processor -- start 2020-04-02T23:46:46.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.150+0000 7f8e43efe700 1 -- start start 2020-04-02T23:46:46.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e43efe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e43efe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0a4bd0 con 0x7f8e3c0a6e80 2020-04-02T23:46:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e43efe700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0605c0 con 0x7f8e3c07fca0 2020-04-02T23:46:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e43efe700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c0a33d0 con 0x7f8e3c14eff0 2020-04-02T23:46:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c1513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53550/0 (socket says 172.21.15.82:53550) 2020-04-02T23:46:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e41c9a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8e3c07fca0 0x7f8e3c080130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53598/0 (socket says 172.21.15.82:53598) 2020-04-02T23:46:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 -- 172.21.15.82:0/3001588863 learned_addr learned my addr 172.21.15.82:0/3001588863 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 -- 172.21.15.82:0/3001588863 >> v1:172.21.15.82:6789/0 conn(0x7f8e3c07fca0 legacy=0x7f8e3c080130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e41499700 1 -- 172.21.15.82:0/3001588863 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411041989 0 0) 0x7f8e3c0605c0 con 0x7f8e3c07fca0 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 -- 172.21.15.82:0/3001588863 >> v1:172.21.15.50:6789/0 conn(0x7f8e3c0a6e80 legacy=0x7f8e3c05b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 -- 172.21.15.82:0/3001588863 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c05b720 con 0x7f8e3c14eff0 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/3001588863 >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c1513e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e3c0a2710 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/3001588863 >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c1513e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e3c0a2710 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/3001588863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c1513e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f8e3c0a2710 tx=0x7f8e34007dc0).ready entity=mon.1 client_cookie=4a3620ada65f8d5f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/3001588863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c1513e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f8e3c0a2710 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e41499700 1 -- 172.21.15.82:0/3001588863 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e3400a160 con 0x7f8e3c14eff0 2020-04-02T23:46:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/3001588863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c1513e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f8e3c0a2710 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/3001588863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c1513e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f8e3c0a2710 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e41499700 1 -- 172.21.15.82:0/3001588863 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400a2c0 con 0x7f8e3c14eff0 2020-04-02T23:46:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e41499700 1 -- 172.21.15.82:0/3001588863 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e3400a6a0 con 0x7f8e3c14eff0 2020-04-02T23:46:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e43efe700 1 -- 172.21.15.82:0/3001588863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 msgr2=0x7f8e3c1513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.151+0000 7f8e43efe700 1 --2- 172.21.15.82:0/3001588863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c1513e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f8e3c0a2710 tx=0x7f8e34007dc0).stop 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.152+0000 7f8e43efe700 1 -- 172.21.15.82:0/3001588863 shutdown_connections 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.152+0000 7f8e43efe700 1 --2- 172.21.15.82:0/3001588863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c1513e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.152+0000 7f8e43efe700 1 -- 172.21.15.82:0/3001588863 >> 172.21.15.82:0/3001588863 conn(0x7f8e3c0aad00 msgr2=0x7f8e3c0ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.152+0000 7f8e43efe700 1 -- 172.21.15.82:0/3001588863 shutdown_connections 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.152+0000 7f8e43efe700 1 -- 172.21.15.82:0/3001588863 wait complete. 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.153+0000 7f8e43efe700 1 Processor -- start 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.153+0000 7f8e43efe700 1 -- start start 2020-04-02T23:46:46.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.153+0000 7f8e43efe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e3c0a6e80 0x7f8e3c12f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.153+0000 7f8e43efe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c12fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.153+0000 7f8e43efe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c064610 con 0x7f8e3c07fca0 2020-04-02T23:46:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.153+0000 7f8e43efe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c064430 con 0x7f8e3c0a6e80 2020-04-02T23:46:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.153+0000 7f8e43efe700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c0648b0 con 0x7f8e3c14eff0 2020-04-02T23:46:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c12fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c12fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53556/0 (socket says 172.21.15.82:53556) 2020-04-02T23:46:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 -- 172.21.15.82:0/269522458 learned_addr learned my addr 172.21.15.82:0/269522458 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 -- 172.21.15.82:0/269522458 >> v2:172.21.15.50:3300/0 conn(0x7f8e3c0a6e80 msgr2=0x7f8e3c12f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> v2:172.21.15.50:3300/0 conn(0x7f8e3c0a6e80 0x7f8e3c12f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 -- 172.21.15.82:0/269522458 >> v1:172.21.15.50:6789/0 conn(0x7f8e3c07fca0 legacy=0x7f8e3c066020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 -- 172.21.15.82:0/269522458 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c066af0 con 0x7f8e3c14eff0 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> v2:172.21.15.82:3300/0 conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:46.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e32ffd700 1 -- 172.21.15.82:0/269522458 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e34005c30 con 0x7f8e3c14eff0 2020-04-02T23:46:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e32ffd700 1 -- 172.21.15.82:0/269522458 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34005d90 con 0x7f8e3c14eff0 2020-04-02T23:46:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e32ffd700 1 -- 172.21.15.82:0/269522458 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e3400f760 con 0x7f8e3c14eff0 2020-04-02T23:46:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c130090 con 0x7f8e3c14eff0 2020-04-02T23:46:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.154+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c150c70 con 0x7f8e3c14eff0 2020-04-02T23:46:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.155+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.155+0000 7f8e32ffd700 1 -- 172.21.15.82:0/269522458 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8e3400f9d0 con 0x7f8e3c14eff0 2020-04-02T23:46:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.155+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.155+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c056c50 con 0x7f8e3c14eff0 2020-04-02T23:46:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.155+0000 7f8e32ffd700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 0x7f8e2404fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.155+0000 7f8e32ffd700 1 -- 172.21.15.82:0/269522458 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f8e34061ee0 con 0x7f8e3c14eff0 2020-04-02T23:46:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.155+0000 7f8e4249b700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 0x7f8e2404fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.156+0000 7f8e4249b700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 0x7f8e2404fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e38001f50 tx=0x7f8e380024a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.156+0000 7f8e4249b700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 0x7f8e2404fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e38001f50 tx=0x7f8e380024a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.156+0000 7f8e4249b700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 0x7f8e2404fac0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f8e38001f50 tx=0x7f8e380024a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:46.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.159+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.159+0000 7f8e32ffd700 1 -- 172.21.15.82:0/269522458 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f8e34064e60 con 0x7f8e3c14eff0 2020-04-02T23:46:46.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.312+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6f6c1e1-951d-41de-86f8-d782b8879e72", "id": 6} v 0) v1 -- 0x7f8e3c056c50 con 0x7f8e3c14eff0 2020-04-02T23:46:46.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.316+0000 7f8e42c9c700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.316+0000 7f8e32ffd700 1 -- 172.21.15.82:0/269522458 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6f6c1e1-951d-41de-86f8-d782b8879e72", "id": 6}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e3403d700 con 0x7f8e3c14eff0 2020-04-02T23:46:46.319 INFO:teuthology.orchestra.run.smithi082.stdout:6 2020-04-02T23:46:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 msgr2=0x7f8e2404fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 0x7f8e2404fac0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f8e38001f50 tx=0x7f8e380024a0).stop 2020-04-02T23:46:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 msgr2=0x7f8e3c12fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f8e3c0653d0 tx=0x7f8e34007dc0).stop 2020-04-02T23:46:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 shutdown_connections 2020-04-02T23:46:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8e2404d600 0x7f8e2404fac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 --2- 172.21.15.82:0/269522458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e3c14eff0 0x7f8e3c12fc30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 --2- 172.21.15.82:0/269522458 >> v2:172.21.15.50:3300/0 conn(0x7f8e3c0a6e80 0x7f8e3c12f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 >> 172.21.15.82:0/269522458 conn(0x7f8e3c0aad00 msgr2=0x7f8e3c11ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 shutdown_connections 2020-04-02T23:46:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.318+0000 7f8e43efe700 1 -- 172.21.15.82:0/269522458 wait complete. 2020-04-02T23:46:46.330 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:46.343 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 5861a0cf-ae82-4888-9623-e5c9a636d664 7 2020-04-02T23:46:46.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.484+0000 7f75290e7700 1 Processor -- start 2020-04-02T23:46:46.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.484+0000 7f75290e7700 1 -- start start 2020-04-02T23:46:46.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f75290e7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75240a6e80 0x7f752405b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:46.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f75290e7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f752407fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:46.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f75290e7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240a4bd0 con 0x7f7524080100 2020-04-02T23:46:46.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f75290e7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240605c0 con 0x7f752405b470 2020-04-02T23:46:46.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f75290e7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240a33d0 con 0x7f75240a6e80 2020-04-02T23:46:46.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75240a6e80 0x7f752405b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75240a6e80 0x7f752405b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53564/0 (socket says 172.21.15.82:53564) 2020-04-02T23:46:46.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 -- 172.21.15.82:0/835534053 learned_addr learned my addr 172.21.15.82:0/835534053 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:46.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f7522d9d700 1 --2- 172.21.15.82:0/835534053 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f752407fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 -- 172.21.15.82:0/835534053 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 msgr2=0x7f752407fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:46.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- 172.21.15.82:0/835534053 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f752407fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:46.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 -- 172.21.15.82:0/835534053 >> v1:172.21.15.50:6789/0 conn(0x7f7524080100 legacy=0x7f75240a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:46.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 -- 172.21.15.82:0/835534053 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75240a3870 con 0x7f75240a6e80 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- 172.21.15.82:0/835534053 >> v2:172.21.15.82:3300/0 conn(0x7f75240a6e80 0x7f752405b010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75240a2710 tx=0x7f7514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- 172.21.15.82:0/835534053 >> v2:172.21.15.82:3300/0 conn(0x7f75240a6e80 0x7f752405b010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75240a2710 tx=0x7f7514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- 172.21.15.82:0/835534053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75240a6e80 0x7f752405b010 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).ready entity=mon.1 client_cookie=7104615469141c19 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- 172.21.15.82:0/835534053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75240a6e80 0x7f752405b010 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- 172.21.15.82:0/835534053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75240a6e80 0x7f752405b010 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752259c700 1 -- 172.21.15.82:0/835534053 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751400a160 con 0x7f75240a6e80 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752359e700 1 --2- 172.21.15.82:0/835534053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75240a6e80 0x7f752405b010 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752259c700 1 -- 172.21.15.82:0/835534053 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400a2c0 con 0x7f75240a6e80 2020-04-02T23:46:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f752259c700 1 -- 172.21.15.82:0/835534053 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751400a6a0 con 0x7f75240a6e80 2020-04-02T23:46:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f75290e7700 1 -- 172.21.15.82:0/835534053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75240a6e80 msgr2=0x7f752405b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.485+0000 7f75290e7700 1 --2- 172.21.15.82:0/835534053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75240a6e80 0x7f752405b010 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).stop 2020-04-02T23:46:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.486+0000 7f75290e7700 1 -- 172.21.15.82:0/835534053 shutdown_connections 2020-04-02T23:46:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.486+0000 7f75290e7700 1 --2- 172.21.15.82:0/835534053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75240a6e80 0x7f752405b010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.486+0000 7f75290e7700 1 --2- 172.21.15.82:0/835534053 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f752407fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.486+0000 7f75290e7700 1 -- 172.21.15.82:0/835534053 >> 172.21.15.82:0/835534053 conn(0x7f75240aad00 msgr2=0x7f75240ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.486+0000 7f75290e7700 1 -- 172.21.15.82:0/835534053 shutdown_connections 2020-04-02T23:46:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.486+0000 7f75290e7700 1 -- 172.21.15.82:0/835534053 wait complete. 2020-04-02T23:46:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.487+0000 7f75290e7700 1 Processor -- start 2020-04-02T23:46:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.487+0000 7f75290e7700 1 -- start start 2020-04-02T23:46:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f75240619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7524080100 0x7f752409fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75240a6e80 0x7f7524121f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752412a300 con 0x7f752405b470 2020-04-02T23:46:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240a0790 con 0x7f7524080100 2020-04-02T23:46:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240a0250 con 0x7f75240a6e80 2020-04-02T23:46:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7524080100 0x7f752409fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7524080100 0x7f752409fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53568/0 (socket says 172.21.15.82:53568) 2020-04-02T23:46:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 -- 172.21.15.82:0/118478830 learned_addr learned my addr 172.21.15.82:0/118478830 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f752359e700 1 --2- 172.21.15.82:0/118478830 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f75240619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75288e6700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75240a6e80 0x7f7524121f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 -- 172.21.15.82:0/118478830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75240a6e80 msgr2=0x7f7524121f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75240a6e80 0x7f7524121f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 -- 172.21.15.82:0/118478830 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 msgr2=0x7f75240619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f75240619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 -- 172.21.15.82:0/118478830 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75240a04f0 con 0x7f7524080100 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> v2:172.21.15.82:3300/0 conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> v2:172.21.15.82:3300/0 conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f750bfff700 1 -- 172.21.15.82:0/118478830 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751800e790 con 0x7f7524080100 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f750bfff700 1 -- 172.21.15.82:0/118478830 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800e8f0 con 0x7f7524080100 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75241250b0 con 0x7f7524080100 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f750bfff700 1 -- 172.21.15.82:0/118478830 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751800ed10 con 0x7f7524080100 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.488+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75241225a0 con 0x7f7524080100 2020-04-02T23:46:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.489+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.489+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75241228b0 con 0x7f7524080100 2020-04-02T23:46:46.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.489+0000 7f750bfff700 1 -- 172.21.15.82:0/118478830 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7518009170 con 0x7f7524080100 2020-04-02T23:46:46.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.489+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.490+0000 7f750bfff700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 0x7f750404fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:46.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.490+0000 7f750bfff700 1 -- 172.21.15.82:0/118478830 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f7518061200 con 0x7f7524080100 2020-04-02T23:46:46.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.490+0000 7f752359e700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 0x7f750404fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:46.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.490+0000 7f752359e700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 0x7f750404fb50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.490+0000 7f752359e700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 0x7f750404fb50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.490+0000 7f752359e700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 0x7f750404fb50 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:46.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.493+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.493+0000 7f750bfff700 1 -- 172.21.15.82:0/118478830 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f75241228b0 con 0x7f7524080100 2020-04-02T23:46:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.646+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5861a0cf-ae82-4888-9623-e5c9a636d664", "id": 7} v 0) v1 -- 0x7f75241228b0 con 0x7f7524080100 2020-04-02T23:46:46.652 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.650+0000 7f7522d9d700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:46.652 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.650+0000 7f750bfff700 1 -- 172.21.15.82:0/118478830 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5861a0cf-ae82-4888-9623-e5c9a636d664", "id": 7}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75241228b0 con 0x7f7524080100 2020-04-02T23:46:46.652 INFO:teuthology.orchestra.run.smithi082.stdout:7 2020-04-02T23:46:46.657 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 msgr2=0x7f750404fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 0x7f750404fb50 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f75240a2710 tx=0x7f7514007dc0).stop 2020-04-02T23:46:46.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 msgr2=0x7f752409fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:46.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f7518002f30 tx=0x7f7518010c70).stop 2020-04-02T23:46:46.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 shutdown_connections 2020-04-02T23:46:46.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f750404d690 0x7f750404fb50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75240a6e80 0x7f7524121f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 --2- 172.21.15.82:0/118478830 >> v2:172.21.15.50:3300/0 conn(0x7f752405b470 0x7f75240619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.659 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 --2- 172.21.15.82:0/118478830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7524080100 0x7f752409fc20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:46.659 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.651+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 >> 172.21.15.82:0/118478830 conn(0x7f75240aad00 msgr2=0x7f75241281a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:46.659 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.652+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 shutdown_connections 2020-04-02T23:46:46.659 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:46.652+0000 7f75290e7700 1 -- 172.21.15.82:0/118478830 wait complete. 2020-04-02T23:46:46.663 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-02T23:46:46.663 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:46.681 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-02T23:46:46.724 INFO:tasks.ceph.osd.4:Started 2020-04-02T23:46:46.724 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-02T23:46:46.724 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:46.742 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-02T23:46:46.784 INFO:tasks.ceph.osd.5:Started 2020-04-02T23:46:46.784 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-02T23:46:46.784 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:46.801 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-02T23:46:46.842 INFO:tasks.ceph.osd.6:Started 2020-04-02T23:46:46.843 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:46.858 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-02T23:46:46.901 INFO:tasks.ceph.osd.7:Started 2020-04-02T23:46:46.901 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-02T23:46:46.901 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:46.915 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-02T23:46:46.957 INFO:tasks.ceph.osd.0:Started 2020-04-02T23:46:46.958 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:46.971 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-02T23:46:47.012 INFO:tasks.ceph.osd.1:Started 2020-04-02T23:46:47.013 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-02T23:46:47.013 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:47.029 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-02T23:46:47.072 INFO:tasks.ceph.osd.2:Started 2020-04-02T23:46:47.072 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-02T23:46:47.072 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:47.085 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-02T23:46:47.128 INFO:tasks.ceph.osd.3:Started 2020-04-02T23:46:47.128 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-02T23:46:47.329 INFO:tasks.ceph.osd.4.smithi050.stderr:2020-04-02T23:46:47.328+0000 7f21703c9ec0 -1 Falling back to public interface 2020-04-02T23:46:47.385 INFO:tasks.ceph.osd.5.smithi050.stderr:2020-04-02T23:46:47.383+0000 7f935fd2eec0 -1 Falling back to public interface 2020-04-02T23:46:47.442 INFO:tasks.ceph.osd.6.smithi050.stderr:2020-04-02T23:46:47.440+0000 7fc454dffec0 -1 Falling back to public interface 2020-04-02T23:46:47.495 INFO:tasks.ceph.osd.7.smithi050.stderr:2020-04-02T23:46:47.493+0000 7f89f181eec0 -1 Falling back to public interface 2020-04-02T23:46:47.549 INFO:tasks.ceph.osd.0.smithi082.stderr:2020-04-02T23:46:47.547+0000 7fe06ca94ec0 -1 Falling back to public interface 2020-04-02T23:46:47.602 INFO:tasks.ceph.osd.1.smithi082.stderr:2020-04-02T23:46:47.600+0000 7ff4e6e89ec0 -1 Falling back to public interface 2020-04-02T23:46:47.664 INFO:tasks.ceph.osd.2.smithi082.stderr:2020-04-02T23:46:47.661+0000 7f496ffdbec0 -1 Falling back to public interface 2020-04-02T23:46:47.719 INFO:tasks.ceph.osd.3.smithi082.stderr:2020-04-02T23:46:47.717+0000 7f7e41d36ec0 -1 Falling back to public interface 2020-04-02T23:46:47.933 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:47.950 INFO:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:46:48.101 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.091+0000 7fa3b7d5f700 1 Processor -- start 2020-04-02T23:46:48.101 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.091+0000 7fa3b7d5f700 1 -- start start 2020-04-02T23:46:48.101 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b7d5f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a7dd0 0x7fa3b00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:48.101 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b7d5f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00a2d70 con 0x7fa3b00a5890 2020-04-02T23:46:48.101 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b7d5f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00a6dc0 con 0x7fa3b00a79f0 2020-04-02T23:46:48.101 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b7d5f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00a7060 con 0x7fa3b00a7dd0 2020-04-02T23:46:48.102 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b62fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa3b00a79f0 0x7fa3b0066f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53648/0 (socket says 172.21.15.82:53648) 2020-04-02T23:46:48.102 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b62fc700 1 -- 172.21.15.82:0/441634057 learned_addr learned my addr 172.21.15.82:0/441634057 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:48.102 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a7dd0 0x7fa3b00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:48.102 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270567316 0 0) 0x7fa3b00a6dc0 con 0x7fa3b00a79f0 2020-04-02T23:46:48.102 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.092+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa39c003230 con 0x7fa3b00a79f0 2020-04-02T23:46:48.102 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3499340088 0 0) 0x7fa39c003230 con 0x7fa3b00a79f0 2020-04-02T23:46:48.102 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a7dd0 msgr2=0x7fa3b00a3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 --2- 172.21.15.82:0/441634057 >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a7dd0 0x7fa3b00a3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 >> v1:172.21.15.50:6789/0 conn(0x7fa3b00a5890 legacy=0x7fa3b014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00a8860 con 0x7fa3b00a79f0 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fa3ac001a50 con 0x7fa3b00a79f0 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 >> v1:172.21.15.82:6789/0 conn(0x7fa3b00a79f0 legacy=0x7fa3b0066f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa39c003720 0x7fa39c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:48.103 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa39c004db0 0x7fa39c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:48.104 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00a7060 con 0x7fa39c003720 2020-04-02T23:46:48.104 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0041c0 con 0x7fa39c0044d0 2020-04-02T23:46:48.104 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c04fb90 con 0x7fa39c004db0 2020-04-02T23:46:48.104 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:48.104 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b62fc700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa39c003720 0x7fa39c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:48.104 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa39c004db0 0x7fa39c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:48.104 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 -- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa39c004db0 msgr2=0x7fa39c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:48.105 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa39c004db0 0x7fa39c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:48.105 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 -- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa39c003720 msgr2=0x7fa39c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:48.105 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa39c003720 0x7fa39c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:48.105 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 -- 172.21.15.82:0/441634057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c003230 con 0x7fa39c0044d0 2020-04-02T23:46:48.105 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa39c004db0 0x7fa39c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:46:48.105 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b62fc700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa39c003720 0x7fa39c003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:46:48.105 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b6afd700 1 -- 172.21.15.82:0/441634057 reap_dead start 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3a0008910 tx=0x7fa3a0010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3a0008910 tx=0x7fa3a0010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fa3a0008910 tx=0x7fa3a0010100).ready entity=mon.1 client_cookie=5433caf6d7da048 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fa3a0008910 tx=0x7fa3a0010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3a0010d90 con 0x7fa39c0044d0 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fa3a0008910 tx=0x7fa3a0010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b5afb700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fa3a0008910 tx=0x7fa3a0010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.106 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0008950 con 0x7fa39c0044d0 2020-04-02T23:46:48.107 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b52fa700 1 -- 172.21.15.82:0/441634057 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3a0008cb0 con 0x7fa39c0044d0 2020-04-02T23:46:48.107 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 msgr2=0x7fa39c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:48.107 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.093+0000 7fa3b7d5f700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fa3a0008910 tx=0x7fa3a0010100).stop 2020-04-02T23:46:48.107 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.094+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/441634057 shutdown_connections 2020-04-02T23:46:48.107 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.094+0000 7fa3b7d5f700 1 --2- 172.21.15.82:0/441634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39c0044d0 0x7fa39c004950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:48.107 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.094+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/441634057 >> 172.21.15.82:0/441634057 conn(0x7fa3b009de60 msgr2=0x7fa3b009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:48.107 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.094+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/441634057 shutdown_connections 2020-04-02T23:46:48.108 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.094+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/441634057 wait complete. 2020-04-02T23:46:48.108 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.095+0000 7fa3b7d5f700 1 Processor -- start 2020-04-02T23:46:48.108 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.095+0000 7fa3b7d5f700 1 -- start start 2020-04-02T23:46:48.108 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b7d5f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a0c80 0x7fa3b00a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:48.108 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b7d5f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00a1be0 con 0x7fa3b0062970 2020-04-02T23:46:48.108 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b7d5f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00a1e80 con 0x7fa39c0044d0 2020-04-02T23:46:48.108 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b7d5f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00a19d0 con 0x7fa3b00a0c80 2020-04-02T23:46:48.109 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b62fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa39c0044d0 0x7fa3b00a0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53656/0 (socket says 172.21.15.82:53656) 2020-04-02T23:46:48.109 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b62fc700 1 -- 172.21.15.82:0/77904593 learned_addr learned my addr 172.21.15.82:0/77904593 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:48.109 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a0c80 0x7fa3b00a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:48.109 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595611180 0 0) 0x7fa3b00a1e80 con 0x7fa39c0044d0 2020-04-02T23:46:48.109 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa398003230 con 0x7fa39c0044d0 2020-04-02T23:46:48.109 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 670476753 0 0) 0x7fa398003230 con 0x7fa39c0044d0 2020-04-02T23:46:48.109 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 -- 172.21.15.82:0/77904593 >> v1:172.21.15.82:6789/0 conn(0x7fa39c0044d0 legacy=0x7fa3b00a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:48.110 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 -- 172.21.15.82:0/77904593 >> v1:172.21.15.50:6789/0 conn(0x7fa3b0062970 legacy=0x7fa3b007ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:48.110 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 -- 172.21.15.82:0/77904593 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0125330 con 0x7fa3b00a0c80 2020-04-02T23:46:48.110 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.110 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> v2:172.21.15.50:3300/0 conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.110 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:48.110 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.110 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3a8001ea0 con 0x7fa3b00a0c80 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8006ac0 con 0x7fa3b00a0c80 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b01255e0 con 0x7fa3b00a0c80 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3ac001a50 con 0x7fa3b00a0c80 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.096+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b007f330 con 0x7fa3b00a0c80 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.097+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.111 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.097+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa3a800a280 con 0x7fa3b00a0c80 2020-04-02T23:46:48.112 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.097+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.112 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.097+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b007f930 con 0x7fa3b00a0c80 2020-04-02T23:46:48.112 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.098+0000 7fa3a6ffd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 0x7fa39804fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:48.112 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.098+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2074+0+0 (secure 0 0 0) 0x7fa3a8060680 con 0x7fa3b00a0c80 2020-04-02T23:46:48.112 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.098+0000 7fa3b62fc700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 0x7fa39804fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:48.112 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.098+0000 7fa3b62fc700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 0x7fa39804fd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3ac002100 tx=0x7fa3b00a89f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.112 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.098+0000 7fa3b62fc700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 0x7fa39804fd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3ac002100 tx=0x7fa3b00a89f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.113 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.098+0000 7fa3b62fc700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 0x7fa39804fd10 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fa3ac002100 tx=0x7fa3b00a89f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:48.113 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.102+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.113 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.102+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa3a803bdc0 con 0x7fa3b00a0c80 2020-04-02T23:46:48.242 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.241+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3b0056c50 con 0x7fa3b00a0c80 2020-04-02T23:46:48.244 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.242+0000 7fa3b6afd700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:48.244 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.242+0000 7fa3a6ffd700 1 -- 172.21.15.82:0/77904593 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8274 (secure 0 0 0) 0x7fa3a803f3e0 con 0x7fa3b00a0c80 2020-04-02T23:46:48.244 INFO:teuthology.misc.health.smithi082.stdout: 2020-04-02T23:46:48.244 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":11,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:46:46.647967+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:46:48.245 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 msgr2=0x7fa39804fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:48.246 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 0x7fa39804fd10 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fa3ac002100 tx=0x7fa3b00a89f0).stop 2020-04-02T23:46:48.246 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 msgr2=0x7fa3b00a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:48.246 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fa3ac0020c0 tx=0x7fa3a8010660).stop 2020-04-02T23:46:48.246 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 shutdown_connections 2020-04-02T23:46:48.246 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b00a0c80 0x7fa3b00a13c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:48.246 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 --2- 172.21.15.82:0/77904593 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa39804d850 0x7fa39804fd10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:48.246 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 >> 172.21.15.82:0/77904593 conn(0x7fa3b009de60 msgr2=0x7fa3b0068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:48.247 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 shutdown_connections 2020-04-02T23:46:48.247 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:48.243+0000 7fa3b7d5f700 1 -- 172.21.15.82:0/77904593 wait complete. 2020-04-02T23:46:48.255 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-02T23:46:48.392 INFO:tasks.ceph.osd.4.smithi050.stderr:2020-04-02T23:46:48.391+0000 7f21703c9ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-02T23:46:48.447 INFO:tasks.ceph.osd.5.smithi050.stderr:2020-04-02T23:46:48.446+0000 7f935fd2eec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-02T23:46:48.508 INFO:tasks.ceph.osd.6.smithi050.stderr:2020-04-02T23:46:48.506+0000 7fc454dffec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-02T23:46:48.575 INFO:tasks.ceph.osd.7.smithi050.stderr:2020-04-02T23:46:48.573+0000 7f89f181eec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-02T23:46:48.616 INFO:tasks.ceph.osd.0.smithi082.stderr:2020-04-02T23:46:48.614+0000 7fe06ca94ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-02T23:46:48.669 INFO:tasks.ceph.osd.1.smithi082.stderr:2020-04-02T23:46:48.667+0000 7ff4e6e89ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-02T23:46:48.736 INFO:tasks.ceph.osd.2.smithi082.stderr:2020-04-02T23:46:48.734+0000 7f496ffdbec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-02T23:46:48.792 INFO:tasks.ceph.osd.3.smithi082.stderr:2020-04-02T23:46:48.791+0000 7f7e41d36ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-02T23:46:50.257 INFO:tasks.ceph.osd.5.smithi050.stderr:2020-04-02T23:46:50.255+0000 7f93484f8700 -1 osd.5 0 waiting for initial osdmap 2020-04-02T23:46:50.257 INFO:tasks.ceph.osd.6.smithi050.stderr:2020-04-02T23:46:50.255+0000 7fc43d5c9700 -1 osd.6 0 waiting for initial osdmap 2020-04-02T23:46:50.260 INFO:tasks.ceph.osd.1.smithi082.stderr:2020-04-02T23:46:50.258+0000 7ff4cf653700 -1 osd.1 0 waiting for initial osdmap 2020-04-02T23:46:50.260 INFO:tasks.ceph.osd.0.smithi082.stderr:2020-04-02T23:46:50.258+0000 7fe05525e700 -1 osd.0 0 waiting for initial osdmap 2020-04-02T23:46:50.261 INFO:tasks.ceph.osd.2.smithi082.stderr:2020-04-02T23:46:50.258+0000 7f49587a5700 -1 osd.2 0 waiting for initial osdmap 2020-04-02T23:46:50.261 INFO:tasks.ceph.osd.3.smithi082.stderr:2020-04-02T23:46:50.259+0000 7f7e2a500700 -1 osd.3 0 waiting for initial osdmap 2020-04-02T23:46:50.262 INFO:tasks.ceph.osd.4.smithi050.stderr:2020-04-02T23:46:50.260+0000 7f2158b93700 -1 osd.4 0 waiting for initial osdmap 2020-04-02T23:46:50.263 INFO:tasks.ceph.osd.7.smithi050.stderr:2020-04-02T23:46:50.261+0000 7f89d9fe8700 -1 osd.7 0 waiting for initial osdmap 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:46:54.292 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:54.334 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:54.351 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:55.064 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:55.081 INFO:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:46:55.225 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.220+0000 7f6fad08d700 1 Processor -- start 2020-04-02T23:46:55.225 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.220+0000 7f6fad08d700 1 -- start start 2020-04-02T23:46:55.225 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.220+0000 7f6fad08d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a7dd0 0x7f6fa80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.225 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.220+0000 7f6fad08d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a5890 0x7f6fa814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.225 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.220+0000 7f6fad08d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa80a2d70 con 0x7f6fa80a79f0 2020-04-02T23:46:55.226 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.220+0000 7f6fad08d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa80a6dc0 con 0x7f6fa80a5890 2020-04-02T23:46:55.226 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.220+0000 7f6fad08d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80a7060 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.226 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fa6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a7dd0 0x7f6fa80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.226 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a5890 0x7f6fa814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.226 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a5890 0x7f6fa814fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:50420/0 (socket says 172.21.15.82:50420) 2020-04-02T23:46:55.227 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fa6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a7dd0 0x7f6fa80a3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:49544/0 (socket says 172.21.15.82:49544) 2020-04-02T23:46:55.227 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 -- 172.21.15.82:0/491984161 learned_addr learned my addr 172.21.15.82:0/491984161 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:55.227 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fa759e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fa80a79f0 0x7f6fa8066f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:57858/0 (socket says 172.21.15.82:57858) 2020-04-02T23:46:55.227 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 -- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a7dd0 msgr2=0x7f6fa80a3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.227 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a7dd0 0x7f6fa80a3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.227 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 -- 172.21.15.82:0/491984161 >> v1:172.21.15.50:6789/0 conn(0x7f6fa80a79f0 legacy=0x7f6fa8066f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.227 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 -- 172.21.15.82:0/491984161 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80a8860 con 0x7f6fa80a5890 2020-04-02T23:46:55.228 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- 172.21.15.82:0/491984161 >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a5890 0x7f6fa814fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.228 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- 172.21.15.82:0/491984161 >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a5890 0x7f6fa814fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.228 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80a5890 0x7f6fa814fd00 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).ready entity=mon.0 client_cookie=2eafcc37f4526360 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.228 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80a5890 0x7f6fa814fd00 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.228 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fa659c700 1 -- 172.21.15.82:0/491984161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f98011670 con 0x7f6fa80a5890 2020-04-02T23:46:55.228 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.221+0000 7f6fac88c700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80a5890 0x7f6fa814fd00 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.228 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fa659c700 1 -- 172.21.15.82:0/491984161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f980117d0 con 0x7f6fa80a5890 2020-04-02T23:46:55.229 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fac88c700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80a5890 0x7f6fa814fd00 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.229 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fa659c700 1 -- 172.21.15.82:0/491984161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f98011bf0 con 0x7f6fa80a5890 2020-04-02T23:46:55.229 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 -- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80a5890 msgr2=0x7f6fa814fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.229 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80a5890 0x7f6fa814fd00 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).stop 2020-04-02T23:46:55.229 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 -- 172.21.15.82:0/491984161 shutdown_connections 2020-04-02T23:46:55.229 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80a5890 0x7f6fa814fd00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.229 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 --2- 172.21.15.82:0/491984161 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a7dd0 0x7f6fa80a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.230 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 -- 172.21.15.82:0/491984161 >> 172.21.15.82:0/491984161 conn(0x7f6fa809de60 msgr2=0x7f6fa809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.230 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 -- 172.21.15.82:0/491984161 shutdown_connections 2020-04-02T23:46:55.230 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.222+0000 7f6fad08d700 1 -- 172.21.15.82:0/491984161 wait complete. 2020-04-02T23:46:55.230 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.223+0000 7f6fad08d700 1 Processor -- start 2020-04-02T23:46:55.233 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.223+0000 7f6fad08d700 1 -- start start 2020-04-02T23:46:55.234 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fad08d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a5890 0x7f6fa80628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.234 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fad08d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a79f0 0x7f6fa80a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.234 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fad08d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6fa80a7dd0 0x7f6fa8123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.234 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fad08d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa80a0be0 con 0x7f6fa80a79f0 2020-04-02T23:46:55.234 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fad08d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa8125b10 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.234 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fad08d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80a06a0 con 0x7f6fa80a5890 2020-04-02T23:46:55.235 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6fa80a7dd0 0x7f6fa8123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.235 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6fa80a7dd0 0x7f6fa8123360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53844/0 (socket says 172.21.15.82:53844) 2020-04-02T23:46:55.235 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 -- 172.21.15.82:0/3246155083 learned_addr learned my addr 172.21.15.82:0/3246155083 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:55.235 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fa6d9d700 1 --2- 172.21.15.82:0/3246155083 >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a79f0 0x7f6fa80a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.235 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fa759e700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a5890 0x7f6fa80628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.235 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 -- 172.21.15.82:0/3246155083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a5890 msgr2=0x7f6fa80628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.235 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a5890 0x7f6fa80628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.236 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 -- 172.21.15.82:0/3246155083 >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a79f0 msgr2=0x7f6fa80a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.236 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a79f0 0x7f6fa80a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.236 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 -- 172.21.15.82:0/3246155083 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80a0940 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.236 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> v2:172.21.15.82:3300/0 conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.236 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> v2:172.21.15.82:3300/0 conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.236 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.224+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.237 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.237 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6f8ffff700 1 -- 172.21.15.82:0/3246155083 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f98011e70 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.237 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.237 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.237 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6f8ffff700 1 -- 172.21.15.82:0/3246155083 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98007150 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.237 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa812a540 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.237 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6f8ffff700 1 -- 172.21.15.82:0/3246155083 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f98007530 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.238 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa8123980 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.238 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.225+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.238 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa8056c50 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.238 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6f8ffff700 1 -- 172.21.15.82:0/3246155083 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6f980056c0 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.238 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.238 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6f8ffff700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 0x7f6f8804f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.238 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6f8ffff700 1 -- 172.21.15.82:0/3246155083 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f6f980612e0 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.239 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6fa759e700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 0x7f6f8804f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.239 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6fa759e700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 0x7f6f8804f9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fa809eda0 tx=0x7f6fa0002120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.239 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6fa759e700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 0x7f6f8804f9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fa809eda0 tx=0x7f6fa0002120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.239 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.226+0000 7f6fa759e700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 0x7f6f8804f9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f6fa809eda0 tx=0x7f6fa0002120).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.239 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.229+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.239 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.229+0000 7f6f8ffff700 1 -- 172.21.15.82:0/3246155083 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f6f9803cb00 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.369 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.367+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fa8080760 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.370 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.368+0000 7f6fac88c700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.370 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.368+0000 7f6f8ffff700 1 -- 172.21.15.82:0/3246155083 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11805 (secure 0 0 0) 0x7f6f98040120 con 0x7f6fa80a7dd0 2020-04-02T23:46:55.370 INFO:teuthology.misc.health.smithi082.stdout: 2020-04-02T23:46:55.370 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":16,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:46:53.272054+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:46:55.372 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 msgr2=0x7f6f8804f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.372 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 0x7f6f8804f9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f6fa809eda0 tx=0x7f6fa0002120).stop 2020-04-02T23:46:55.373 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 msgr2=0x7f6fa8123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.373 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f6f98002f30 tx=0x7f6f98007a40).stop 2020-04-02T23:46:55.373 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 shutdown_connections 2020-04-02T23:46:55.374 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f6f8804d520 0x7f6f8804f9e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.374 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa80a7dd0 0x7f6fa8123360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.374 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 --2- 172.21.15.82:0/3246155083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fa80a5890 0x7f6fa80628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.374 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 --2- 172.21.15.82:0/3246155083 >> v2:172.21.15.50:3300/0 conn(0x7f6fa80a79f0 0x7f6fa80a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.374 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 >> 172.21.15.82:0/3246155083 conn(0x7f6fa809de60 msgr2=0x7f6fa8068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.374 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 shutdown_connections 2020-04-02T23:46:55.374 INFO:teuthology.misc.health.smithi082.stderr:2020-04-02T23:46:55.369+0000 7f6fad08d700 1 -- 172.21.15.82:0/3246155083 wait complete. 2020-04-02T23:46:55.381 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-02T23:46:55.381 INFO:tasks.ceph:Creating RBD pool 2020-04-02T23:46:55.381 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:55.395 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-02T23:46:55.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.543+0000 7f204f07f700 1 Processor -- start 2020-04-02T23:46:55.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.543+0000 7f204f07f700 1 -- start start 2020-04-02T23:46:55.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.543+0000 7f204f07f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f204805c1e0 0x7f20480a26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.543+0000 7f204f07f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f20480a6c90 0x7f204807fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.543+0000 7f204f07f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480a4010 con 0x7f204807fed0 2020-04-02T23:46:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.543+0000 7f204f07f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480a50b0 con 0x7f204805c1e0 2020-04-02T23:46:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.543+0000 7f204f07f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480a4240 con 0x7f20480a6c90 2020-04-02T23:46:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f20480a6c90 0x7f204807fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f20480a6c90 0x7f204807fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53850/0 (socket says 172.21.15.82:53850) 2020-04-02T23:46:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 -- 172.21.15.82:0/2686972987 learned_addr learned my addr 172.21.15.82:0/2686972987 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204d61c700 1 --2- 172.21.15.82:0/2686972987 >> v2:172.21.15.50:3300/0 conn(0x7f204805c1e0 0x7f20480a26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 -- 172.21.15.82:0/2686972987 >> v2:172.21.15.50:3300/0 conn(0x7f204805c1e0 msgr2=0x7f20480a26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- 172.21.15.82:0/2686972987 >> v2:172.21.15.50:3300/0 conn(0x7f204805c1e0 0x7f20480a26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 -- 172.21.15.82:0/2686972987 >> v1:172.21.15.50:6789/0 conn(0x7f204807fed0 legacy=0x7f20480a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 -- 172.21.15.82:0/2686972987 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480a4a60 con 0x7f20480a6c90 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- 172.21.15.82:0/2686972987 >> v2:172.21.15.82:3300/0 conn(0x7f20480a6c90 0x7f204807fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20480a3cc0 tx=0x7f2044007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- 172.21.15.82:0/2686972987 >> v2:172.21.15.82:3300/0 conn(0x7f20480a6c90 0x7f204807fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20480a3cc0 tx=0x7f2044007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- 172.21.15.82:0/2686972987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20480a6c90 0x7f204807fa70 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f20480a3cc0 tx=0x7f2044007a40).ready entity=mon.1 client_cookie=816b6d5162005cb5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- 172.21.15.82:0/2686972987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20480a6c90 0x7f204807fa70 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f20480a3cc0 tx=0x7f2044007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f203ffff700 1 -- 172.21.15.82:0/2686972987 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20440116e0 con 0x7f20480a6c90 2020-04-02T23:46:55.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- 172.21.15.82:0/2686972987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20480a6c90 0x7f204807fa70 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f20480a3cc0 tx=0x7f2044007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204ce1b700 1 --2- 172.21.15.82:0/2686972987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20480a6c90 0x7f204807fa70 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f20480a3cc0 tx=0x7f2044007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f203ffff700 1 -- 172.21.15.82:0/2686972987 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044011840 con 0x7f20480a6c90 2020-04-02T23:46:55.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f203ffff700 1 -- 172.21.15.82:0/2686972987 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044011c20 con 0x7f20480a6c90 2020-04-02T23:46:55.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204f07f700 1 -- 172.21.15.82:0/2686972987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20480a6c90 msgr2=0x7f204807fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.544+0000 7f204f07f700 1 --2- 172.21.15.82:0/2686972987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20480a6c90 0x7f204807fa70 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f20480a3cc0 tx=0x7f2044007a40).stop 2020-04-02T23:46:55.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.545+0000 7f204f07f700 1 -- 172.21.15.82:0/2686972987 shutdown_connections 2020-04-02T23:46:55.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.545+0000 7f204f07f700 1 --2- 172.21.15.82:0/2686972987 >> v2:172.21.15.50:3300/0 conn(0x7f204805c1e0 0x7f20480a26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.545+0000 7f204f07f700 1 --2- 172.21.15.82:0/2686972987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20480a6c90 0x7f204807fa70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.545+0000 7f204f07f700 1 -- 172.21.15.82:0/2686972987 >> 172.21.15.82:0/2686972987 conn(0x7f20480a77b0 msgr2=0x7f20480a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.545+0000 7f204f07f700 1 -- 172.21.15.82:0/2686972987 shutdown_connections 2020-04-02T23:46:55.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.545+0000 7f204f07f700 1 -- 172.21.15.82:0/2686972987 wait complete. 2020-04-02T23:46:55.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.546+0000 7f204f07f700 1 Processor -- start 2020-04-02T23:46:55.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.546+0000 7f204f07f700 1 -- start start 2020-04-02T23:46:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204f07f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 0x7f204807f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204f07f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480654a0 con 0x7f204807fed0 2020-04-02T23:46:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204f07f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480a3110 con 0x7f204805c1e0 2020-04-02T23:46:55.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204f07f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204809c4a0 con 0x7f20480a6c90 2020-04-02T23:46:55.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204d61c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f204805c1e0 0x7f2048064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53906/0 (socket says 172.21.15.82:53906) 2020-04-02T23:46:55.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204d61c700 1 -- 172.21.15.82:0/1474919195 learned_addr learned my addr 172.21.15.82:0/1474919195 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:55.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204de1d700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 0x7f204807f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985824443 0 0) 0x7f20480a3110 con 0x7f204805c1e0 2020-04-02T23:46:55.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2028003230 con 0x7f204805c1e0 2020-04-02T23:46:55.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997921036 0 0) 0x7f20480654a0 con 0x7f204807fed0 2020-04-02T23:46:55.561 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20480a3110 con 0x7f204807fed0 2020-04-02T23:46:55.561 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1910712540 0 0) 0x7f2028003230 con 0x7f204805c1e0 2020-04-02T23:46:55.561 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f20480654a0 con 0x7f204805c1e0 2020-04-02T23:46:55.561 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f2038002710 con 0x7f204805c1e0 2020-04-02T23:46:55.561 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 msgr2=0x7f204807f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.561 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 0x7f204807f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.561 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 >> v1:172.21.15.82:6789/0 conn(0x7f204805c1e0 legacy=0x7f2048064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 >> v1:172.21.15.50:6789/0 conn(0x7f204807fed0 legacy=0x7f204807f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2028003960 0x7f2028003d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 0x7f2028004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204809c4a0 con 0x7f2028003960 2020-04-02T23:46:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2028005210 con 0x7f20280044d0 2020-04-02T23:46:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202800b720 con 0x7f20480a6c90 2020-04-02T23:46:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204d61c700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2028003960 0x7f2028003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.547+0000 7f204de1d700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 0x7f2028004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 -- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 msgr2=0x7f2028004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 0x7f2028004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 -- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2028003960 msgr2=0x7f2028003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2028003960 0x7f2028003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204809c9e0 con 0x7f20280044d0 2020-04-02T23:46:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204809cc80 con 0x7f20280044d0 2020-04-02T23:46:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204de1d700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f20480a6c90 0x7f2028004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:46:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2048066cc0 con 0x7f20280044d0 2020-04-02T23:46:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044011e90 con 0x7f20280044d0 2020-04-02T23:46:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044007bd0 con 0x7f20280044d0 2020-04-02T23:46:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044007530 con 0x7f20280044d0 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.548+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2020003340 con 0x7f20280044d0 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f20440056c0 con 0x7f20280044d0 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f203dffb700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2028055930 0x7f2028057df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f2044061560 con 0x7f20280044d0 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f204d61c700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2028055930 0x7f2028057df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f204d61c700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2028055930 0x7f2028057df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20380024e0 tx=0x7f203800bfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f204d61c700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2028055930 0x7f2028057df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20380024e0 tx=0x7f203800bfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.549+0000 7f204d61c700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2028055930 0x7f2028057df0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f20380024e0 tx=0x7f203800bfe0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.552+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.552+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f204403cd80 con 0x7f20280044d0 2020-04-02T23:46:55.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:55.691+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f20200035b0 con 0x7f20280044d0 2020-04-02T23:46:56.290 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.287+0000 7f204ce1b700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.290 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.287+0000 7f203dffb700 1 -- 172.21.15.82:0/1474919195 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f20440403a0 con 0x7f20280044d0 2020-04-02T23:46:56.292 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2028055930 msgr2=0x7f2028057df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.292 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2028055930 0x7f2028057df0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f20380024e0 tx=0x7f203800bfe0).stop 2020-04-02T23:46:56.292 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 msgr2=0x7f2028004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 --2- 172.21.15.82:0/1474919195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20280044d0 0x7f2028004950 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f20440102c0 tx=0x7f2028004440).stop 2020-04-02T23:46:56.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204de1d700 1 -- 172.21.15.82:0/1474919195 reap_dead start 2020-04-02T23:46:56.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204de1d700 1 -- 172.21.15.82:0/1474919195 reap_dead start 2020-04-02T23:46:56.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 shutdown_connections 2020-04-02T23:46:56.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 >> 172.21.15.82:0/1474919195 conn(0x7f20480a77b0 msgr2=0x7f20480a25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 shutdown_connections 2020-04-02T23:46:56.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.290+0000 7f204f07f700 1 -- 172.21.15.82:0/1474919195 wait complete. 2020-04-02T23:46:56.294 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'rbd' created 2020-04-02T23:46:56.303 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:56.317 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-02T23:46:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.464+0000 7f15631b8700 1 Processor -- start 2020-04-02T23:46:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f15631b8700 1 -- start start 2020-04-02T23:46:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f15631b8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f155c0a3480 0x7f155c0a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f15631b8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f155c0a6f00 0x7f155c0a6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f15631b8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c060600 con 0x7f155c0a3af0 2020-04-02T23:46:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f15631b8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c0a5870 con 0x7f155c0a6f00 2020-04-02T23:46:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f15631b8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c0a5b10 con 0x7f155c0a3480 2020-04-02T23:46:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f1561755700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f155c0a3480 0x7f155c0a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f1561755700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f155c0a3480 0x7f155c0a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53870/0 (socket says 172.21.15.82:53870) 2020-04-02T23:46:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.465+0000 7f1561755700 1 -- 172.21.15.82:0/3214573630 learned_addr learned my addr 172.21.15.82:0/3214573630 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1560f54700 1 --2- 172.21.15.82:0/3214573630 >> v2:172.21.15.50:3300/0 conn(0x7f155c0a6f00 0x7f155c0a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 -- 172.21.15.82:0/3214573630 >> v2:172.21.15.50:3300/0 conn(0x7f155c0a6f00 msgr2=0x7f155c0a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 --2- 172.21.15.82:0/3214573630 >> v2:172.21.15.50:3300/0 conn(0x7f155c0a6f00 0x7f155c0a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 -- 172.21.15.82:0/3214573630 >> v1:172.21.15.50:6789/0 conn(0x7f155c0a3af0 legacy=0x7f155c0a3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 -- 172.21.15.82:0/3214573630 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0a55b0 con 0x7f155c0a3480 2020-04-02T23:46:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 --2- 172.21.15.82:0/3214573630 >> v2:172.21.15.82:3300/0 conn(0x7f155c0a3480 0x7f155c0a5fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f155c0a3a10 tx=0x7f1558007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 --2- 172.21.15.82:0/3214573630 >> v2:172.21.15.82:3300/0 conn(0x7f155c0a3480 0x7f155c0a5fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f155c0a3a10 tx=0x7f1558007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 --2- 172.21.15.82:0/3214573630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f155c0a3480 0x7f155c0a5fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f155c0a3a10 tx=0x7f1558007dc0).ready entity=mon.1 client_cookie=bf0ef91163cac4ba server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 --2- 172.21.15.82:0/3214573630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f155c0a3480 0x7f155c0a5fb0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f155c0a3a10 tx=0x7f1558007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1553fff700 1 -- 172.21.15.82:0/3214573630 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155800a160 con 0x7f155c0a3480 2020-04-02T23:46:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 --2- 172.21.15.82:0/3214573630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f155c0a3480 0x7f155c0a5fb0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f155c0a3a10 tx=0x7f1558007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1561755700 1 --2- 172.21.15.82:0/3214573630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f155c0a3480 0x7f155c0a5fb0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f155c0a3a10 tx=0x7f1558007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1553fff700 1 -- 172.21.15.82:0/3214573630 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155800a2c0 con 0x7f155c0a3480 2020-04-02T23:46:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f1553fff700 1 -- 172.21.15.82:0/3214573630 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155800a6a0 con 0x7f155c0a3480 2020-04-02T23:46:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 -- 172.21.15.82:0/3214573630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f155c0a3480 msgr2=0x7f155c0a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 --2- 172.21.15.82:0/3214573630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f155c0a3480 0x7f155c0a5fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f155c0a3a10 tx=0x7f1558007dc0).stop 2020-04-02T23:46:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 -- 172.21.15.82:0/3214573630 shutdown_connections 2020-04-02T23:46:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 --2- 172.21.15.82:0/3214573630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f155c0a3480 0x7f155c0a5fb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 --2- 172.21.15.82:0/3214573630 >> v2:172.21.15.50:3300/0 conn(0x7f155c0a6f00 0x7f155c0a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 -- 172.21.15.82:0/3214573630 >> 172.21.15.82:0/3214573630 conn(0x7f155c0aad00 msgr2=0x7f155c0ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 -- 172.21.15.82:0/3214573630 shutdown_connections 2020-04-02T23:46:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.466+0000 7f15631b8700 1 -- 172.21.15.82:0/3214573630 wait complete. 2020-04-02T23:46:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.467+0000 7f15631b8700 1 Processor -- start 2020-04-02T23:46:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f15631b8700 1 -- start start 2020-04-02T23:46:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f15631b8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f15631b8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c0802a0 con 0x7f155c0a3480 2020-04-02T23:46:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f15631b8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c112e10 con 0x7f155c0a6f00 2020-04-02T23:46:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f15631b8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c067320 con 0x7f155c0a3af0 2020-04-02T23:46:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f1561f56700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f155c0a6f00 0x7f155c07d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53928/0 (socket says 172.21.15.82:53928) 2020-04-02T23:46:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f1561f56700 1 -- 172.21.15.82:0/2847826119 learned_addr learned my addr 172.21.15.82:0/2847826119 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.468+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139766067 0 0) 0x7f155c112e10 con 0x7f155c0a6f00 2020-04-02T23:46:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c003230 con 0x7f155c0a6f00 2020-04-02T23:46:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357614812 0 0) 0x7f155c0802a0 con 0x7f155c0a3480 2020-04-02T23:46:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155c112e10 con 0x7f155c0a3480 2020-04-02T23:46:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 -- 172.21.15.82:0/2847826119 >> v1:172.21.15.82:6789/0 conn(0x7f155c0a6f00 legacy=0x7f155c07d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 -- 172.21.15.82:0/2847826119 >> v1:172.21.15.50:6789/0 conn(0x7f155c0a3480 legacy=0x7f155c064b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 -- 172.21.15.82:0/2847826119 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c1130b0 con 0x7f155c0a3af0 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154c008df0 con 0x7f155c0a3af0 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c113350 con 0x7f155c0a3af0 2020-04-02T23:46:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c0056c0 con 0x7f155c0a3af0 2020-04-02T23:46:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154c005aa0 con 0x7f155c0a3af0 2020-04-02T23:46:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.469+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c065cc0 con 0x7f155c0a3af0 2020-04-02T23:46:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.470+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.470+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c056c50 con 0x7f155c0a3af0 2020-04-02T23:46:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.470+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f154c005d20 con 0x7f155c0a3af0 2020-04-02T23:46:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.470+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.470+0000 7f1551ffb700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 0x7f153c04ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.470+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f154c060f10 con 0x7f155c0a3af0 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.471+0000 7f1561755700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 0x7f153c04ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.471+0000 7f1561755700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 0x7f153c04ff50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1558010640 tx=0x7f1558007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.471+0000 7f1561755700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 0x7f153c04ff50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1558010640 tx=0x7f1558007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.471+0000 7f1561755700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 0x7f153c04ff50 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f1558010640 tx=0x7f1558007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.474+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.474+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f154c03c5f0 con 0x7f155c0a3af0 2020-04-02T23:46:56.615 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:56.613+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f155c1134e0 con 0x7f155c0a3af0 2020-04-02T23:46:57.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.292+0000 7f1560f54700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.294 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.292+0000 7f1551ffb700 1 -- 172.21.15.82:0/2847826119 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f155c1134e0 con 0x7f155c0a3af0 2020-04-02T23:46:57.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 msgr2=0x7f153c04ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 0x7f153c04ff50 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f1558010640 tx=0x7f1558007dc0).stop 2020-04-02T23:46:57.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 msgr2=0x7f155c07cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f154c002f30 tx=0x7f154c010bd0).stop 2020-04-02T23:46:57.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 shutdown_connections 2020-04-02T23:46:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f153c04da90 0x7f153c04ff50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 --2- 172.21.15.82:0/2847826119 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f155c0a3af0 0x7f155c07cf70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 >> 172.21.15.82:0/2847826119 conn(0x7f155c0aad00 msgr2=0x7f155c0a8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 shutdown_connections 2020-04-02T23:46:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.294+0000 7f15631b8700 1 -- 172.21.15.82:0/2847826119 wait complete. 2020-04-02T23:46:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-02T23:46:57.306 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-04-02T23:46:57.307 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:57.321 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:46:57.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.465+0000 7f949d786700 1 Processor -- start 2020-04-02T23:46:57.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.465+0000 7f949d786700 1 -- start start 2020-04-02T23:46:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.465+0000 7f949d786700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94980a6ba0 0x7f94980a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.465+0000 7f949d786700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94980a9f40 con 0x7f94981393e0 2020-04-02T23:46:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.465+0000 7f949d786700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94980aa180 con 0x7f94980ac740 2020-04-02T23:46:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.465+0000 7f949d786700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94980aa420 con 0x7f94980a6ba0 2020-04-02T23:46:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9497fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f94980ac740 0x7f9498138cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53932/0 (socket says 172.21.15.82:53932) 2020-04-02T23:46:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9497fff700 1 -- 172.21.15.82:0/2602816364 learned_addr learned my addr 172.21.15.82:0/2602816364 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f94977fe700 1 --2- 172.21.15.82:0/2602816364 >> v2:172.21.15.50:3300/0 conn(0x7f94980a6ba0 0x7f94980a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061783535 0 0) 0x7f94980aa180 con 0x7f94980ac740 2020-04-02T23:46:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9484003230 con 0x7f94980ac740 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 892473006 0 0) 0x7f9484003230 con 0x7f94980ac740 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 >> v2:172.21.15.50:3300/0 conn(0x7f94980a6ba0 msgr2=0x7f94980a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 --2- 172.21.15.82:0/2602816364 >> v2:172.21.15.50:3300/0 conn(0x7f94980a6ba0 0x7f94980a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 >> v1:172.21.15.50:6789/0 conn(0x7f94981393e0 legacy=0x7f9498066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980aa6c0 con 0x7f94980ac740 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f94880016d0 con 0x7f94980ac740 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 >> v1:172.21.15.82:6789/0 conn(0x7f94980ac740 legacy=0x7f9498138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9484003720 0x7f9484003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94840044d0 0x7f9484004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94980aa420 con 0x7f94840044d0 2020-04-02T23:46:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840041c0 con 0x7f9484004db0 2020-04-02T23:46:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948400bb80 con 0x7f9484003720 2020-04-02T23:46:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f9497fff700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9484003720 0x7f9484003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.466+0000 7f94977fe700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94840044d0 0x7f9484004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 -- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9484003720 msgr2=0x7f9484003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9484003720 0x7f9484003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 -- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94840044d0 msgr2=0x7f9484004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94840044d0 0x7f9484004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 -- 172.21.15.82:0/2602816364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484003230 con 0x7f9484004db0 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f94840054a0 tx=0x7f94900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 -- 172.21.15.82:0/2602816364 reap_dead start 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f94840054a0 tx=0x7f94900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f94840054a0 tx=0x7f94900100a0).ready entity=mon.1 client_cookie=61c00ac8870963f8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f94840054a0 tx=0x7f94900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9490006c40 con 0x7f9484004db0 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f94840054a0 tx=0x7f94900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949cf85700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f94840054a0 tx=0x7f94900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490006da0 con 0x7f9484004db0 2020-04-02T23:46:57.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f9496ffd700 1 -- 172.21.15.82:0/2602816364 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9490002640 con 0x7f9484004db0 2020-04-02T23:46:57.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949d786700 1 -- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 msgr2=0x7f948400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949d786700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f94840054a0 tx=0x7f94900100a0).stop 2020-04-02T23:46:57.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949d786700 1 -- 172.21.15.82:0/2602816364 shutdown_connections 2020-04-02T23:46:57.480 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949d786700 1 --2- 172.21.15.82:0/2602816364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9484004db0 0x7f948400b720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949d786700 1 -- 172.21.15.82:0/2602816364 >> 172.21.15.82:0/2602816364 conn(0x7f94980afc00 msgr2=0x7f94980abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949d786700 1 -- 172.21.15.82:0/2602816364 shutdown_connections 2020-04-02T23:46:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.467+0000 7f949d786700 1 -- 172.21.15.82:0/2602816364 wait complete. 2020-04-02T23:46:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.468+0000 7f949d786700 1 Processor -- start 2020-04-02T23:46:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.468+0000 7f949d786700 1 -- start start 2020-04-02T23:46:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f949d786700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94980a4840 0x7f94980a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f949d786700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498135b60 con 0x7f9484004db0 2020-04-02T23:46:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f949d786700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949814a590 con 0x7f949813a7f0 2020-04-02T23:46:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f949d786700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9498135380 con 0x7f94980a4840 2020-04-02T23:46:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94980a4840 0x7f94980a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94980a4840 0x7f94980a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53896/0 (socket says 172.21.15.82:53896) 2020-04-02T23:46:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 -- 172.21.15.82:0/3867817668 learned_addr learned my addr 172.21.15.82:0/3867817668 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 -- 172.21.15.82:0/3867817668 >> v1:172.21.15.82:6789/0 conn(0x7f949813a7f0 legacy=0x7f9498149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 -- 172.21.15.82:0/3867817668 >> v1:172.21.15.50:6789/0 conn(0x7f9484004db0 legacy=0x7f9498149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 -- 172.21.15.82:0/3867817668 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498135620 con 0x7f94980a4840 2020-04-02T23:46:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114191557 0 0) 0x7f949814a590 con 0x7f949813a7f0 2020-04-02T23:46:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> v2:172.21.15.82:3300/0 conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> v2:172.21.15.82:3300/0 conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.469+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f948c005e90 con 0x7f94980a4840 2020-04-02T23:46:57.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.470+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.470+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.470+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c007160 con 0x7f94980a4840 2020-04-02T23:46:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.470+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94981358c0 con 0x7f94980a4840 2020-04-02T23:46:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.470+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f948c007580 con 0x7f94980a4840 2020-04-02T23:46:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.470+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9498139c00 con 0x7f94980a4840 2020-04-02T23:46:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.470+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9498056c50 con 0x7f94980a4840 2020-04-02T23:46:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f948c008410 con 0x7f94980a4840 2020-04-02T23:46:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f94957fa700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 0x7f947804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f948c060e60 con 0x7f94980a4840 2020-04-02T23:46:57.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f9497fff700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 0x7f947804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f9497fff700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 0x7f947804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f94980a5200 tx=0x7f9498060730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f9497fff700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 0x7f947804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f94980a5200 tx=0x7f9498060730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.471+0000 7f9497fff700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 0x7f947804f8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f94980a5200 tx=0x7f9498060730).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.474+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.474+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f948c03c560 con 0x7f94980a4840 2020-04-02T23:46:57.615 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.613+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f949813ec40 con 0x7f94980a4840 2020-04-02T23:46:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.614+0000 7f94977fe700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.614+0000 7f94957fa700 1 -- 172.21.15.82:0/3867817668 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f948c03fb80 con 0x7f94980a4840 2020-04-02T23:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:46:57.286206+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:46:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 msgr2=0x7f947804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 0x7f947804f8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f94980a5200 tx=0x7f9498060730).stop 2020-04-02T23:46:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 msgr2=0x7f94980a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f948c002f30 tx=0x7f948c007fe0).stop 2020-04-02T23:46:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 shutdown_connections 2020-04-02T23:46:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f947804d420 0x7f947804f8e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 --2- 172.21.15.82:0/3867817668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94980a4840 0x7f94980a5eb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 >> 172.21.15.82:0/3867817668 conn(0x7f94980afc00 msgr2=0x7f9498068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 shutdown_connections 2020-04-02T23:46:57.621 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.616+0000 7f949d786700 1 -- 172.21.15.82:0/3867817668 wait complete. 2020-04-02T23:46:57.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:42.430184+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:55.708328+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:46:57.629 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:57.641 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:46:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.799+0000 7f852476e700 1 Processor -- start 2020-04-02T23:46:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.799+0000 7f852476e700 1 -- start start 2020-04-02T23:46:57.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f852476e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c065cc0 0x7f851c0aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f852476e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c139220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f852476e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c0aabc0 con 0x7f851c0658e0 2020-04-02T23:46:57.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f852476e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c133470 con 0x7f851c138d90 2020-04-02T23:46:57.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f852476e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c09f3c0 con 0x7f851c065cc0 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c139220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53906/0 (socket says 172.21.15.82:53906) 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f852250a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f851c0658e0 0x7f851c05c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53952/0 (socket says 172.21.15.82:53952) 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 -- 172.21.15.82:0/70079674 learned_addr learned my addr 172.21.15.82:0/70079674 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8521d09700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c065cc0 0x7f851c0aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 -- 172.21.15.82:0/70079674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c065cc0 msgr2=0x7f851c0aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c065cc0 0x7f851c0aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 -- 172.21.15.82:0/70079674 >> v1:172.21.15.82:6789/0 conn(0x7f851c0658e0 legacy=0x7f851c05c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 -- 172.21.15.82:0/70079674 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c09f660 con 0x7f851c138d90 2020-04-02T23:46:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8521508700 1 -- 172.21.15.82:0/70079674 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286332690 0 0) 0x7f85180010d0 con 0x7f851c0658e0 2020-04-02T23:46:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8521d09700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c065cc0 0x7f851c0aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- 172.21.15.82:0/70079674 >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c139220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- 172.21.15.82:0/70079674 >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c139220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c139220 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).ready entity=mon.1 client_cookie=9dd5c36282c84f6a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c139220 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8521508700 1 -- 172.21.15.82:0/70079674 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851400a160 con 0x7f851c138d90 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c139220 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8522d0b700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c139220 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.800+0000 7f8521508700 1 -- 172.21.15.82:0/70079674 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400a2c0 con 0x7f851c138d90 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f8521508700 1 -- 172.21.15.82:0/70079674 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851400a6a0 con 0x7f851c138d90 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 -- 172.21.15.82:0/70079674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 msgr2=0x7f851c139220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c139220 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).stop 2020-04-02T23:46:57.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 -- 172.21.15.82:0/70079674 shutdown_connections 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c139220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 --2- 172.21.15.82:0/70079674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c065cc0 0x7f851c0aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 -- 172.21.15.82:0/70079674 >> 172.21.15.82:0/70079674 conn(0x7f851c0af2e0 msgr2=0x7f851c0af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 -- 172.21.15.82:0/70079674 shutdown_connections 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.801+0000 7f852476e700 1 -- 172.21.15.82:0/70079674 wait complete. 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.802+0000 7f852476e700 1 Processor -- start 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.802+0000 7f852476e700 1 -- start start 2020-04-02T23:46:57.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.802+0000 7f852476e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c12c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f852476e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c135ce0 con 0x7f851c065cc0 2020-04-02T23:46:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f852476e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c135f80 con 0x7f851c0658e0 2020-04-02T23:46:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f852476e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c136220 con 0x7f851c138d90 2020-04-02T23:46:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f852250a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f851c0658e0 0x7f851c146770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53958/0 (socket says 172.21.15.82:53958) 2020-04-02T23:46:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f852250a700 1 -- 172.21.15.82:0/731077208 learned_addr learned my addr 172.21.15.82:0/731077208 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c12c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 -- 172.21.15.82:0/731077208 >> v1:172.21.15.82:6789/0 conn(0x7f851c0658e0 legacy=0x7f851c146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 -- 172.21.15.82:0/731077208 >> v1:172.21.15.50:6789/0 conn(0x7f851c065cc0 legacy=0x7f851c12a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175733471 0 0) 0x7f851c135f80 con 0x7f851c0658e0 2020-04-02T23:46:57.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 -- 172.21.15.82:0/731077208 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c1359d0 con 0x7f851c138d90 2020-04-02T23:46:57.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> v2:172.21.15.82:3300/0 conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8514005c30 con 0x7f851c138d90 2020-04-02T23:46:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c136940 con 0x7f851c138d90 2020-04-02T23:46:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514005d90 con 0x7f851c138d90 2020-04-02T23:46:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8514007340 con 0x7f851c138d90 2020-04-02T23:46:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.803+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c12f370 con 0x7f851c138d90 2020-04-02T23:46:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.804+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.815 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.804+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c056c50 con 0x7f851c138d90 2020-04-02T23:46:57.815 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8514007540 con 0x7f851c138d90 2020-04-02T23:46:57.815 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f850b7fe700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 0x7f84fc04f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8514061e20 con 0x7f851c138d90 2020-04-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f852250a700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 0x7f84fc04f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f852250a700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 0x7f84fc04f830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8518001180 tx=0x7f85180017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f852250a700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 0x7f84fc04f830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8518001180 tx=0x7f85180017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.805+0000 7f852250a700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 0x7f84fc04f830 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f8518001180 tx=0x7f85180017c0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.808+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.808+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f851403d620 con 0x7f851c138d90 2020-04-02T23:46:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.947+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f851c05d150 con 0x7f851c138d90 2020-04-02T23:46:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.947+0000 7f8522d0b700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.947+0000 7f850b7fe700 1 -- 172.21.15.82:0/731077208 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8514040c40 con 0x7f851c138d90 2020-04-02T23:46:57.950 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2020-04-02T23:46:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 msgr2=0x7f84fc04f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 0x7f84fc04f830 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f8518001180 tx=0x7f85180017c0).stop 2020-04-02T23:46:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 msgr2=0x7f851c12c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f85140032b0 tx=0x7f8514007dc0).stop 2020-04-02T23:46:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 shutdown_connections 2020-04-02T23:46:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f84fc04d370 0x7f84fc04f830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 --2- 172.21.15.82:0/731077208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f851c138d90 0x7f851c12c680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 >> 172.21.15.82:0/731077208 conn(0x7f851c0af2e0 msgr2=0x7f851c0aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 shutdown_connections 2020-04-02T23:46:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:57.949+0000 7f852476e700 1 -- 172.21.15.82:0/731077208 wait complete. 2020-04-02T23:46:57.961 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:57.973 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:46:58.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.119+0000 7f9920ea7700 1 Processor -- start 2020-04-02T23:46:58.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.119+0000 7f9920ea7700 1 -- start start 2020-04-02T23:46:58.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9920ea7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f991c065cc0 0x7f991c0aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:58.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9920ea7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f991c138d90 0x7f991c1391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:58.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9920ea7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0aabc0 con 0x7f991c0658e0 2020-04-02T23:46:58.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9920ea7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c133470 con 0x7f991c138d90 2020-04-02T23:46:58.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9920ea7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c09f3c0 con 0x7f991c065cc0 2020-04-02T23:46:58.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f991c065cc0 0x7f991c0aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f991c065cc0 0x7f991c0aa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53920/0 (socket says 172.21.15.82:53920) 2020-04-02T23:46:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 -- 172.21.15.82:0/1901129380 learned_addr learned my addr 172.21.15.82:0/1901129380 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f991a59c700 1 --1- 172.21.15.82:0/1901129380 >> v1:172.21.15.82:6789/0 conn(0x7f991c0658e0 0x7f991c05c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53966/0 (socket says 172.21.15.82:53966) 2020-04-02T23:46:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f991ad9d700 1 --2- 172.21.15.82:0/1901129380 >> v2:172.21.15.50:3300/0 conn(0x7f991c138d90 0x7f991c1391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 -- 172.21.15.82:0/1901129380 >> v2:172.21.15.50:3300/0 conn(0x7f991c138d90 msgr2=0x7f991c1391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- 172.21.15.82:0/1901129380 >> v2:172.21.15.50:3300/0 conn(0x7f991c138d90 0x7f991c1391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 -- 172.21.15.82:0/1901129380 >> v1:172.21.15.82:6789/0 conn(0x7f991c0658e0 legacy=0x7f991c05c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 -- 172.21.15.82:0/1901129380 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c09f660 con 0x7f991c065cc0 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f991959a700 1 -- 172.21.15.82:0/1901129380 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285393616 0 0) 0x7f99040010d0 con 0x7f991c0658e0 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- 172.21.15.82:0/1901129380 >> v2:172.21.15.82:3300/0 conn(0x7f991c065cc0 0x7f991c0aa760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f990c0032b0 tx=0x7f990c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- 172.21.15.82:0/1901129380 >> v2:172.21.15.82:3300/0 conn(0x7f991c065cc0 0x7f991c0aa760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f990c0032b0 tx=0x7f990c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- 172.21.15.82:0/1901129380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c065cc0 0x7f991c0aa760 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f990c0032b0 tx=0x7f990c007dc0).ready entity=mon.1 client_cookie=8f172d8338ff8f2f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- 172.21.15.82:0/1901129380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c065cc0 0x7f991c0aa760 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f990c0032b0 tx=0x7f990c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f991959a700 1 -- 172.21.15.82:0/1901129380 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990c00a160 con 0x7f991c065cc0 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- 172.21.15.82:0/1901129380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c065cc0 0x7f991c0aa760 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f990c0032b0 tx=0x7f990c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f991959a700 1 -- 172.21.15.82:0/1901129380 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c00a2c0 con 0x7f991c065cc0 2020-04-02T23:46:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9919d9b700 1 --2- 172.21.15.82:0/1901129380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c065cc0 0x7f991c0aa760 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f990c0032b0 tx=0x7f990c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f991959a700 1 -- 172.21.15.82:0/1901129380 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990c00a660 con 0x7f991c065cc0 2020-04-02T23:46:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9920ea7700 1 -- 172.21.15.82:0/1901129380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c065cc0 msgr2=0x7f991c0aa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.120+0000 7f9920ea7700 1 --2- 172.21.15.82:0/1901129380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c065cc0 0x7f991c0aa760 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f990c0032b0 tx=0x7f990c007dc0).stop 2020-04-02T23:46:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.121+0000 7f9920ea7700 1 -- 172.21.15.82:0/1901129380 shutdown_connections 2020-04-02T23:46:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.121+0000 7f9920ea7700 1 --2- 172.21.15.82:0/1901129380 >> v2:172.21.15.50:3300/0 conn(0x7f991c138d90 0x7f991c1391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.121+0000 7f9920ea7700 1 --2- 172.21.15.82:0/1901129380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c065cc0 0x7f991c0aa760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.121+0000 7f9920ea7700 1 -- 172.21.15.82:0/1901129380 >> 172.21.15.82:0/1901129380 conn(0x7f991c0af2e0 msgr2=0x7f991c0af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.121+0000 7f9920ea7700 1 -- 172.21.15.82:0/1901129380 shutdown_connections 2020-04-02T23:46:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.121+0000 7f9920ea7700 1 -- 172.21.15.82:0/1901129380 wait complete. 2020-04-02T23:46:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 Processor -- start 2020-04-02T23:46:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 -- start start 2020-04-02T23:46:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f991c0658e0 0x7f991c0a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c065cc0 0x7f991c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f991c138d90 0x7f991c149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c0a42b0 con 0x7f991c0658e0 2020-04-02T23:46:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c149fa0 con 0x7f991c138d90 2020-04-02T23:46:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f9920ea7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0a2ff0 con 0x7f991c065cc0 2020-04-02T23:46:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.122+0000 7f991ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f991c138d90 0x7f991c149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f991c138d90 0x7f991c149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53926/0 (socket says 172.21.15.82:53926) 2020-04-02T23:46:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 -- 172.21.15.82:0/2572971276 learned_addr learned my addr 172.21.15.82:0/2572971276 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991a59c700 1 --2- 172.21.15.82:0/2572971276 >> v2:172.21.15.50:3300/0 conn(0x7f991c0658e0 0x7f991c0a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f9919d9b700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c065cc0 0x7f991c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 -- 172.21.15.82:0/2572971276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c065cc0 msgr2=0x7f991c1496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c065cc0 0x7f991c1496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 -- 172.21.15.82:0/2572971276 >> v2:172.21.15.50:3300/0 conn(0x7f991c0658e0 msgr2=0x7f991c0a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> v2:172.21.15.50:3300/0 conn(0x7f991c0658e0 0x7f991c0a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 -- 172.21.15.82:0/2572971276 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0a3290 con 0x7f991c138d90 2020-04-02T23:46:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f9919d9b700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c065cc0 0x7f991c1496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> v2:172.21.15.82:3300/0 conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> v2:172.21.15.82:3300/0 conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f99137fe700 1 -- 172.21.15.82:0/2572971276 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9914005e90 con 0x7f991c138d90 2020-04-02T23:46:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f99137fe700 1 -- 172.21.15.82:0/2572971276 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914007160 con 0x7f991c138d90 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f99137fe700 1 -- 172.21.15.82:0/2572971276 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9914007500 con 0x7f991c138d90 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c0a3530 con 0x7f991c138d90 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.123+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c1364a0 con 0x7f991c138d90 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.124+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.124+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.124+0000 7f99137fe700 1 -- 172.21.15.82:0/2572971276 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f99140122c0 con 0x7f991c138d90 2020-04-02T23:46:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.124+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c056c50 con 0x7f991c138d90 2020-04-02T23:46:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.124+0000 7f99137fe700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 0x7f990004fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.124+0000 7f99137fe700 1 -- 172.21.15.82:0/2572971276 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9914061450 con 0x7f991c138d90 2020-04-02T23:46:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.124+0000 7f991a59c700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 0x7f990004fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.125+0000 7f991a59c700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 0x7f990004fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9904000b80 tx=0x7f99040017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.125+0000 7f991a59c700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 0x7f990004fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9904000b80 tx=0x7f99040017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.125+0000 7f991a59c700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 0x7f990004fac0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f9904000b80 tx=0x7f99040017c0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.138 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.128+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.138 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.128+0000 7f99137fe700 1 -- 172.21.15.82:0/2572971276 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f991403cab0 con 0x7f991c138d90 2020-04-02T23:46:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.265+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f991c05d150 con 0x7f991c138d90 2020-04-02T23:46:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.265+0000 7f991ad9d700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.265+0000 7f99137fe700 1 -- 172.21.15.82:0/2572971276 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99140400d0 con 0x7f991c138d90 2020-04-02T23:46:58.268 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:46:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 msgr2=0x7f990004fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 0x7f990004fac0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f9904000b80 tx=0x7f99040017c0).stop 2020-04-02T23:46:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 msgr2=0x7f991c149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f9914002f30 tx=0x7f9914010c20).stop 2020-04-02T23:46:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 shutdown_connections 2020-04-02T23:46:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f990004d600 0x7f990004fac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c138d90 0x7f991c149b40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 --2- 172.21.15.82:0/2572971276 >> v2:172.21.15.50:3300/0 conn(0x7f991c0658e0 0x7f991c0a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 --2- 172.21.15.82:0/2572971276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c065cc0 0x7f991c1496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 >> 172.21.15.82:0/2572971276 conn(0x7f991c0af2e0 msgr2=0x7f991c0ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 shutdown_connections 2020-04-02T23:46:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.266+0000 7f9920ea7700 1 -- 172.21.15.82:0/2572971276 wait complete. 2020-04-02T23:46:58.278 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:58.292 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-02T23:46:58.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.435+0000 7f05745db700 1 Processor -- start 2020-04-02T23:46:58.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.435+0000 7f05745db700 1 -- start start 2020-04-02T23:46:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f05745db700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f056c0a3e20 0x7f056c138680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f05745db700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f05745db700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c0a77a0 con 0x7f056c0abb00 2020-04-02T23:46:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f05745db700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c1395c0 con 0x7f056c0a3e20 2020-04-02T23:46:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f05745db700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c138ae0 con 0x7f056c066dd0 2020-04-02T23:46:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53930/0 (socket says 172.21.15.82:53930) 2020-04-02T23:46:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 -- 172.21.15.82:0/1738526302 learned_addr learned my addr 172.21.15.82:0/1738526302 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 -- 172.21.15.82:0/1738526302 >> v2:172.21.15.50:3300/0 conn(0x7f056c0a3e20 msgr2=0x7f056c138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0571b76700 1 --2- 172.21.15.82:0/1738526302 >> v2:172.21.15.50:3300/0 conn(0x7f056c0a3e20 0x7f056c138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 --2- 172.21.15.82:0/1738526302 >> v2:172.21.15.50:3300/0 conn(0x7f056c0a3e20 0x7f056c138680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 -- 172.21.15.82:0/1738526302 >> v1:172.21.15.50:6789/0 conn(0x7f056c0abb00 legacy=0x7f056c0666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 -- 172.21.15.82:0/1738526302 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0a62b0 con 0x7f056c066dd0 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0571b76700 1 --2- 172.21.15.82:0/1738526302 >> v2:172.21.15.50:3300/0 conn(0x7f056c0a3e20 0x7f056c138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.436+0000 7f0572b78700 1 --2- 172.21.15.82:0/1738526302 >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a69f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f056c0a2710 tx=0x7f0564007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0572b78700 1 --2- 172.21.15.82:0/1738526302 >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a69f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f056c0a2710 tx=0x7f0564007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0572b78700 1 --2- 172.21.15.82:0/1738526302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a69f0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f056c0a2710 tx=0x7f0564007dc0).ready entity=mon.1 client_cookie=47688c5a240befdc server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0572b78700 1 --2- 172.21.15.82:0/1738526302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a69f0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f056c0a2710 tx=0x7f0564007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0571375700 1 -- 172.21.15.82:0/1738526302 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056400a160 con 0x7f056c066dd0 2020-04-02T23:46:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0572b78700 1 --2- 172.21.15.82:0/1738526302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a69f0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f056c0a2710 tx=0x7f0564007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0571375700 1 -- 172.21.15.82:0/1738526302 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056400a2c0 con 0x7f056c066dd0 2020-04-02T23:46:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0572b78700 1 --2- 172.21.15.82:0/1738526302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a69f0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f056c0a2710 tx=0x7f0564007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f0571375700 1 -- 172.21.15.82:0/1738526302 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056400a6a0 con 0x7f056c066dd0 2020-04-02T23:46:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 -- 172.21.15.82:0/1738526302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 msgr2=0x7f056c0a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 --2- 172.21.15.82:0/1738526302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a69f0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f056c0a2710 tx=0x7f0564007dc0).stop 2020-04-02T23:46:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 -- 172.21.15.82:0/1738526302 shutdown_connections 2020-04-02T23:46:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 --2- 172.21.15.82:0/1738526302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a69f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 --2- 172.21.15.82:0/1738526302 >> v2:172.21.15.50:3300/0 conn(0x7f056c0a3e20 0x7f056c138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 -- 172.21.15.82:0/1738526302 >> 172.21.15.82:0/1738526302 conn(0x7f056c09de60 msgr2=0x7f056c09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 -- 172.21.15.82:0/1738526302 shutdown_connections 2020-04-02T23:46:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.437+0000 7f05745db700 1 -- 172.21.15.82:0/1738526302 wait complete. 2020-04-02T23:46:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.438+0000 7f05745db700 1 Processor -- start 2020-04-02T23:46:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.438+0000 7f05745db700 1 -- start start 2020-04-02T23:46:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f05745db700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f05745db700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f056c0a3e20 0x7f056c144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f05745db700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f056c0abb00 0x7f056c09f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f05745db700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c0a1370 con 0x7f056c0abb00 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f05745db700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c0a1610 con 0x7f056c066dd0 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f05745db700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c135610 con 0x7f056c0a3e20 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53934/0 (socket says 172.21.15.82:53934) 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 -- 172.21.15.82:0/4189119031 learned_addr learned my addr 172.21.15.82:0/4189119031 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572b78700 1 --2- 172.21.15.82:0/4189119031 >> v2:172.21.15.50:3300/0 conn(0x7f056c0abb00 0x7f056c09f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0571b76700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f056c0a3e20 0x7f056c144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 -- 172.21.15.82:0/4189119031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f056c0a3e20 msgr2=0x7f056c144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f056c0a3e20 0x7f056c144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 -- 172.21.15.82:0/4189119031 >> v2:172.21.15.50:3300/0 conn(0x7f056c0abb00 msgr2=0x7f056c09f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> v2:172.21.15.50:3300/0 conn(0x7f056c0abb00 0x7f056c09f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 -- 172.21.15.82:0/4189119031 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c1352a0 con 0x7f056c066dd0 2020-04-02T23:46:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> v2:172.21.15.82:3300/0 conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f055b7fe700 1 -- 172.21.15.82:0/4189119031 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055c00cc20 con 0x7f056c066dd0 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f055b7fe700 1 -- 172.21.15.82:0/4189119031 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c00cd80 con 0x7f056c066dd0 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f055b7fe700 1 -- 172.21.15.82:0/4189119031 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055c00e350 con 0x7f056c066dd0 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.439+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c0a1c10 con 0x7f056c066dd0 2020-04-02T23:46:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.440+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c135cf0 con 0x7f056c066dd0 2020-04-02T23:46:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.440+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c056c50 con 0x7f056c066dd0 2020-04-02T23:46:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f055b7fe700 1 -- 172.21.15.82:0/4189119031 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f055c00e5c0 con 0x7f056c066dd0 2020-04-02T23:46:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f055b7fe700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 0x7f054c04fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f055b7fe700 1 -- 172.21.15.82:0/4189119031 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f055c060ca0 con 0x7f056c066dd0 2020-04-02T23:46:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f0571b76700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 0x7f054c04fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f0571b76700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 0x7f054c04fa30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0568002f30 tx=0x7f0568006ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f0571b76700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 0x7f054c04fa30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0568002f30 tx=0x7f0568006ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.441+0000 7f0571b76700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 0x7f054c04fa30 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f0568002f30 tx=0x7f0568006ef0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.444+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.444+0000 7f055b7fe700 1 -- 172.21.15.82:0/4189119031 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f055c03c400 con 0x7f056c066dd0 2020-04-02T23:46:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.585+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f056c05d150 con 0x7f056c066dd0 2020-04-02T23:46:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.586+0000 7f0572377700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.586+0000 7f055b7fe700 1 -- 172.21.15.82:0/4189119031 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+143 (secure 0 0 0) 0x7f055c03fa20 con 0x7f056c066dd0 2020-04-02T23:46:58.588 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:46:58.588 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2020-04-02T23:46:58.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2020-04-02T23:46:58.589 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2020-04-02T23:46:58.589 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "device_health_metrics" 2020-04-02T23:46:58.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2020-04-02T23:46:58.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2020-04-02T23:46:58.589 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2020-04-02T23:46:58.589 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2020-04-02T23:46:58.590 INFO:teuthology.orchestra.run.smithi082.stdout: } 2020-04-02T23:46:58.590 INFO:teuthology.orchestra.run.smithi082.stdout:] 2020-04-02T23:46:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 msgr2=0x7f054c04fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 0x7f054c04fa30 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f0568002f30 tx=0x7f0568006ef0).stop 2020-04-02T23:46:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 msgr2=0x7f056c0a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f055c001f50 tx=0x7f055c010960).stop 2020-04-02T23:46:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 shutdown_connections 2020-04-02T23:46:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f054c04d570 0x7f054c04fa30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 --2- 172.21.15.82:0/4189119031 >> v2:172.21.15.50:3300/0 conn(0x7f056c0abb00 0x7f056c09f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056c066dd0 0x7f056c0a0e30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 --2- 172.21.15.82:0/4189119031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f056c0a3e20 0x7f056c144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 >> 172.21.15.82:0/4189119031 conn(0x7f056c09de60 msgr2=0x7f056c068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 shutdown_connections 2020-04-02T23:46:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.587+0000 7f05745db700 1 -- 172.21.15.82:0/4189119031 wait complete. 2020-04-02T23:46:58.600 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-02T23:46:58.600 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:58.613 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-02T23:46:58.761 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.759+0000 7ff9fd522700 1 Processor -- start 2020-04-02T23:46:58.761 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.759+0000 7ff9fd522700 1 -- start start 2020-04-02T23:46:58.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9fd522700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9f80a8410 0x7ff9f809f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9fd522700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f8135ff0 0x7ff9f8136440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9fd522700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f80a3960 con 0x7ff9f80a6e70 2020-04-02T23:46:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9fd522700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80a4890 con 0x7ff9f8135ff0 2020-04-02T23:46:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9fd522700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80a73f0 con 0x7ff9f80a8410 2020-04-02T23:46:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9f77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f8135ff0 0x7ff9f8136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9f67fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff9f80a6e70 0x7ff9f80a3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53994/0 (socket says 172.21.15.82:53994) 2020-04-02T23:46:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9f67fc700 1 -- 172.21.15.82:0/2624139579 learned_addr learned my addr 172.21.15.82:0/2624139579 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.760+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9f80a8410 0x7ff9f809f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 -- 172.21.15.82:0/2624139579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9f80a8410 msgr2=0x7ff9f809f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9f80a8410 0x7ff9f809f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 -- 172.21.15.82:0/2624139579 >> v1:172.21.15.82:6789/0 conn(0x7ff9f80a6e70 legacy=0x7ff9f80a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f5ffb700 1 -- 172.21.15.82:0/2624139579 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084554893 0 0) 0x7ff9f80a3960 con 0x7ff9f80a6e70 2020-04-02T23:46:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 -- 172.21.15.82:0/2624139579 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80a6a40 con 0x7ff9f8135ff0 2020-04-02T23:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9f80a8410 0x7ff9f809f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/2624139579 >> v2:172.21.15.82:3300/0 conn(0x7ff9f8135ff0 0x7ff9f8136440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9f00032b0 tx=0x7ff9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/2624139579 >> v2:172.21.15.82:3300/0 conn(0x7ff9f8135ff0 0x7ff9f8136440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9f00032b0 tx=0x7ff9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8135ff0 0x7ff9f8136440 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7ff9f00032b0 tx=0x7ff9f0007dc0).ready entity=mon.1 client_cookie=8a7d0eed86cc32c0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8135ff0 0x7ff9f8136440 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff9f00032b0 tx=0x7ff9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f5ffb700 1 -- 172.21.15.82:0/2624139579 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f0010e60 con 0x7ff9f8135ff0 2020-04-02T23:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8135ff0 0x7ff9f8136440 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff9f00032b0 tx=0x7ff9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f5ffb700 1 -- 172.21.15.82:0/2624139579 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f00110c0 con 0x7ff9f8135ff0 2020-04-02T23:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8135ff0 0x7ff9f8136440 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff9f00032b0 tx=0x7ff9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9f5ffb700 1 -- 172.21.15.82:0/2624139579 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f0011460 con 0x7ff9f8135ff0 2020-04-02T23:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 -- 172.21.15.82:0/2624139579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8135ff0 msgr2=0x7ff9f8136440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8135ff0 0x7ff9f8136440 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7ff9f00032b0 tx=0x7ff9f0007dc0).stop 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 -- 172.21.15.82:0/2624139579 shutdown_connections 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8135ff0 0x7ff9f8136440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 --2- 172.21.15.82:0/2624139579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9f80a8410 0x7ff9f809f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 -- 172.21.15.82:0/2624139579 >> 172.21.15.82:0/2624139579 conn(0x7ff9f80ab970 msgr2=0x7ff9f80a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 -- 172.21.15.82:0/2624139579 shutdown_connections 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.761+0000 7ff9fd522700 1 -- 172.21.15.82:0/2624139579 wait complete. 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.762+0000 7ff9fd522700 1 Processor -- start 2020-04-02T23:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.762+0000 7ff9fd522700 1 -- start start 2020-04-02T23:46:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9fd522700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f80a6e70 0x7ff9f8065230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9fd522700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f809db10 con 0x7ff9f8135ff0 2020-04-02T23:46:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9fd522700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f809d4a0 con 0x7ff9f80a8410 2020-04-02T23:46:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9fd522700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f809d850 con 0x7ff9f80a6e70 2020-04-02T23:46:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f80a6e70 0x7ff9f8065230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f67fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff9f80a8410 0x7ff9f81490d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54002/0 (socket says 172.21.15.82:54002) 2020-04-02T23:46:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f80a6e70 0x7ff9f8065230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53950/0 (socket says 172.21.15.82:53950) 2020-04-02T23:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f67fc700 1 -- 172.21.15.82:0/2917124887 learned_addr learned my addr 172.21.15.82:0/2917124887 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/2917124887 >> v1:172.21.15.82:6789/0 conn(0x7ff9f80a8410 legacy=0x7ff9f81490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/2917124887 >> v1:172.21.15.50:6789/0 conn(0x7ff9f8135ff0 legacy=0x7ff9f8151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718400715 0 0) 0x7ff9f809d4a0 con 0x7ff9f80a8410 2020-04-02T23:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/2917124887 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80a6620 con 0x7ff9f80a6e70 2020-04-02T23:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> v2:172.21.15.82:3300/0 conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> v2:172.21.15.82:3300/0 conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9ec0091a0 con 0x7ff9f80a6e70 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec009300 con 0x7ff9f80a6e70 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9ec009720 con 0x7ff9f80a6e70 2020-04-02T23:46:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.763+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8133740 con 0x7ff9f80a6e70 2020-04-02T23:46:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.764+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f809ba30 con 0x7ff9f80a6e70 2020-04-02T23:46:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.764+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.764+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f8064f70 con 0x7ff9f80a6e70 2020-04-02T23:46:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.764+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff9ec007170 con 0x7ff9f80a6e70 2020-04-02T23:46:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.764+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.765+0000 7ff9e7fff700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 0x7ff9d404f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.765+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff9ec060bf0 con 0x7ff9f80a6e70 2020-04-02T23:46:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.765+0000 7ff9f67fc700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 0x7ff9d404f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.765+0000 7ff9f67fc700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 0x7ff9d404f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9e8005500 tx=0x7ff9e80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.765+0000 7ff9f67fc700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 0x7ff9d404f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9e8005500 tx=0x7ff9e80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.765+0000 7ff9f67fc700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 0x7ff9d404f8a0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7ff9e8005500 tx=0x7ff9e80017a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.768+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.768+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff9f8064f70 con 0x7ff9f80a6e70 2020-04-02T23:46:58.906 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:58.904+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff9f8064f70 con 0x7ff9f80a6e70 2020-04-02T23:46:59.303 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.300+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.303 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.300+0000 7ff9e7fff700 1 -- 172.21.15.82:0/2917124887 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v20) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff9f8064f70 con 0x7ff9f80a6e70 2020-04-02T23:46:59.304 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 msgr2=0x7ff9d404f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:59.304 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 0x7ff9d404f8a0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7ff9e8005500 tx=0x7ff9e80017a0).stop 2020-04-02T23:46:59.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 msgr2=0x7ff9f8065230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:59.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7ff9f809d3c0 tx=0x7ff9ec010ae0).stop 2020-04-02T23:46:59.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 shutdown_connections 2020-04-02T23:46:59.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80a6e70 0x7ff9f8065230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:59.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 --2- 172.21.15.82:0/2917124887 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff9d404d3e0 0x7ff9d404f8a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:59.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 >> 172.21.15.82:0/2917124887 conn(0x7ff9f80ab970 msgr2=0x7ff9f80a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:59.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 shutdown_connections 2020-04-02T23:46:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.302+0000 7ff9fd522700 1 -- 172.21.15.82:0/2917124887 wait complete. 2020-04-02T23:46:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2020-04-02T23:46:59.314 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-04-02T23:46:59.314 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:46:59.327 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-04-02T23:46:59.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.475+0000 7f7cc1196700 1 Processor -- start 2020-04-02T23:46:59.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.475+0000 7f7cc1196700 1 -- start start 2020-04-02T23:46:59.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cc1196700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc0a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:59.483 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cc1196700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc1363f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:59.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cc1196700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cbc0a3960 con 0x7f7cbc0a8410 2020-04-02T23:46:59.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cc1196700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc0a4890 con 0x7f7cbc135ff0 2020-04-02T23:46:59.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cc1196700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc0a73f0 con 0x7f7cbc09f610 2020-04-02T23:46:59.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc0a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:59.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cbad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7cbc0a8410 0x7f7cbc0a3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54008/0 (socket says 172.21.15.82:54008) 2020-04-02T23:46:59.484 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cbad9d700 1 -- 172.21.15.82:0/3539188775 learned_addr learned my addr 172.21.15.82:0/3539188775 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:46:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cbb59e700 1 --2- 172.21.15.82:0/3539188775 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc1363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 -- 172.21.15.82:0/3539188775 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 msgr2=0x7f7cbc1363f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 --2- 172.21.15.82:0/3539188775 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc1363f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 -- 172.21.15.82:0/3539188775 >> v1:172.21.15.82:6789/0 conn(0x7f7cbc0a8410 legacy=0x7f7cbc0a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cb9d9b700 1 -- 172.21.15.82:0/3539188775 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182097996 0 0) 0x7f7cbc0a3960 con 0x7f7cbc0a8410 2020-04-02T23:46:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 -- 172.21.15.82:0/3539188775 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc0a6a40 con 0x7f7cbc09f610 2020-04-02T23:46:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 --2- 172.21.15.82:0/3539188775 >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc0a6e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7cac002f30 tx=0x7f7cac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 --2- 172.21.15.82:0/3539188775 >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc0a6e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7cac002f30 tx=0x7f7cac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 --2- 172.21.15.82:0/3539188775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc0a6e70 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).ready entity=mon.1 client_cookie=359d608407e22c73 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 --2- 172.21.15.82:0/3539188775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc0a6e70 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cb9d9b700 1 -- 172.21.15.82:0/3539188775 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac008d00 con 0x7f7cbc09f610 2020-04-02T23:46:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.476+0000 7f7cba59c700 1 --2- 172.21.15.82:0/3539188775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc0a6e70 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cba59c700 1 --2- 172.21.15.82:0/3539188775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc0a6e70 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cb9d9b700 1 -- 172.21.15.82:0/3539188775 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac008e60 con 0x7f7cbc09f610 2020-04-02T23:46:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cb9d9b700 1 -- 172.21.15.82:0/3539188775 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac0108f0 con 0x7f7cbc09f610 2020-04-02T23:46:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 -- 172.21.15.82:0/3539188775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 msgr2=0x7f7cbc0a6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 --2- 172.21.15.82:0/3539188775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc0a6e70 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).stop 2020-04-02T23:46:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 -- 172.21.15.82:0/3539188775 shutdown_connections 2020-04-02T23:46:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 --2- 172.21.15.82:0/3539188775 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc1363f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 --2- 172.21.15.82:0/3539188775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc0a6e70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 -- 172.21.15.82:0/3539188775 >> 172.21.15.82:0/3539188775 conn(0x7f7cbc0ab970 msgr2=0x7f7cbc0a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 -- 172.21.15.82:0/3539188775 shutdown_connections 2020-04-02T23:46:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.477+0000 7f7cc1196700 1 -- 172.21.15.82:0/3539188775 wait complete. 2020-04-02T23:46:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 Processor -- start 2020-04-02T23:46:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 -- start start 2020-04-02T23:46:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc1289d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7cbc0a8410 0x7f7cbc128e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc09b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc09e300 con 0x7f7cbc135ff0 2020-04-02T23:46:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc147f90 con 0x7f7cbc09f610 2020-04-02T23:46:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cc1196700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc148230 con 0x7f7cbc0a8410 2020-04-02T23:46:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.478+0000 7f7cbad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc1289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc1289d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53964/0 (socket says 172.21.15.82:53964) 2020-04-02T23:46:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 -- 172.21.15.82:0/663229133 learned_addr learned my addr 172.21.15.82:0/663229133 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:46:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbb59e700 1 --2- 172.21.15.82:0/663229133 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc09b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cba59c700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7cbc0a8410 0x7f7cbc128e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 -- 172.21.15.82:0/663229133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7cbc0a8410 msgr2=0x7f7cbc128e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7cbc0a8410 0x7f7cbc128e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 -- 172.21.15.82:0/663229133 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 msgr2=0x7f7cbc09b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc09b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 -- 172.21.15.82:0/663229133 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc12a660 con 0x7f7cbc09f610 2020-04-02T23:46:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cba59c700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7cbc0a8410 0x7f7cbc128e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> v2:172.21.15.82:3300/0 conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cabfff700 1 -- 172.21.15.82:0/663229133 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cb0005ca0 con 0x7f7cbc09f610 2020-04-02T23:46:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cabfff700 1 -- 172.21.15.82:0/663229133 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0005e00 con 0x7f7cbc09f610 2020-04-02T23:46:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cbc1364f0 con 0x7f7cbc09f610 2020-04-02T23:46:59.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cabfff700 1 -- 172.21.15.82:0/663229133 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cb00062b0 con 0x7f7cbc09f610 2020-04-02T23:46:59.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.479+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cbc09e4a0 con 0x7f7cbc09f610 2020-04-02T23:46:59.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.480+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.480+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cbc056c50 con 0x7f7cbc09f610 2020-04-02T23:46:59.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.480+0000 7f7cabfff700 1 -- 172.21.15.82:0/663229133 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7cb0006520 con 0x7f7cbc09f610 2020-04-02T23:46:59.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.480+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.480+0000 7f7cabfff700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 0x7f7c9804f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:59.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.480+0000 7f7cabfff700 1 -- 172.21.15.82:0/663229133 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7cb0061060 con 0x7f7cbc09f610 2020-04-02T23:46:59.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.481+0000 7f7cba59c700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 0x7f7c9804f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:59.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.481+0000 7f7cba59c700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 0x7f7c9804f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.481+0000 7f7cba59c700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 0x7f7c9804f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.481+0000 7f7cba59c700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 0x7f7c9804f9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.484+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.484+0000 7f7cabfff700 1 -- 172.21.15.82:0/663229133 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7cb003c760 con 0x7f7cbc09f610 2020-04-02T23:46:59.636 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:46:59.634+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7cbc05d150 con 0x7f7cbc09f610 2020-04-02T23:47:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.301+0000 7f7cbad9d700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.301+0000 7f7cabfff700 1 -- 172.21.15.82:0/663229133 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 154+0+0 (secure 0 0 0) 0x7f7cb003fd80 con 0x7f7cbc09f610 2020-04-02T23:47:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 msgr2=0x7f7c9804f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 0x7f7c9804f9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f7cac002f30 tx=0x7f7cac007a40).stop 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 msgr2=0x7f7cbc1289d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f7cb0000b80 tx=0x7f7cb0010a10).stop 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 shutdown_connections 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c9804d530 0x7f7c9804f9f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 --2- 172.21.15.82:0/663229133 >> v2:172.21.15.50:3300/0 conn(0x7f7cbc135ff0 0x7f7cbc09b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc09f610 0x7f7cbc1289d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 --2- 172.21.15.82:0/663229133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7cbc0a8410 0x7f7cbc128e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 >> 172.21.15.82:0/663229133 conn(0x7f7cbc0ab970 msgr2=0x7f7cbc068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 shutdown_connections 2020-04-02T23:47:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.304+0000 7f7cc1196700 1 -- 172.21.15.82:0/663229133 wait complete. 2020-04-02T23:47:00.319 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:00.334 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-04-02T23:47:00.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.486+0000 7f0d6ff73700 1 Processor -- start 2020-04-02T23:47:00.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.486+0000 7f0d6ff73700 1 -- start start 2020-04-02T23:47:00.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6ff73700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d680aa560 0x7f0d6813c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:00.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6ff73700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d6805f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:00.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6ff73700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d680a9a00 con 0x7f0d6813cdc0 2020-04-02T23:47:00.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6ff73700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6813c220 con 0x7f0d680aa560 2020-04-02T23:47:00.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6ff73700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6813c4c0 con 0x7f0d6805f4f0 2020-04-02T23:47:00.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d680aa560 0x7f0d6813c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:00.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d680aa560 0x7f0d6813c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53972/0 (socket says 172.21.15.82:53972) 2020-04-02T23:47:00.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 -- 172.21.15.82:0/1732313749 learned_addr learned my addr 172.21.15.82:0/1732313749 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:00.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d6805f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:00.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 -- 172.21.15.82:0/1732313749 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 msgr2=0x7f0d6805f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:00.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d6805f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:00.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 -- 172.21.15.82:0/1732313749 >> v1:172.21.15.50:6789/0 conn(0x7f0d6813cdc0 legacy=0x7f0d680a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:00.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 -- 172.21.15.82:0/1732313749 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d680aa940 con 0x7f0d680aa560 2020-04-02T23:47:00.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d6805f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:00.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.487+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1732313749 >> v2:172.21.15.82:3300/0 conn(0x7f0d680aa560 0x7f0d6813c960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d68062520 tx=0x7f0d58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1732313749 >> v2:172.21.15.82:3300/0 conn(0x7f0d680aa560 0x7f0d6813c960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d68062520 tx=0x7f0d58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680aa560 0x7f0d6813c960 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).ready entity=mon.1 client_cookie=2897a9b4d7af189c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:00.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680aa560 0x7f0d6813c960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680aa560 0x7f0d6813c960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6cd0d700 1 -- 172.21.15.82:0/1732313749 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d580116e0 con 0x7f0d680aa560 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680aa560 0x7f0d6813c960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6cd0d700 1 -- 172.21.15.82:0/1732313749 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58011840 con 0x7f0d680aa560 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6cd0d700 1 -- 172.21.15.82:0/1732313749 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d58011c60 con 0x7f0d680aa560 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1732313749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680aa560 msgr2=0x7f0d6813c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680aa560 0x7f0d6813c960 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).stop 2020-04-02T23:47:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1732313749 shutdown_connections 2020-04-02T23:47:00.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d6805f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:00.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1732313749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680aa560 0x7f0d6813c960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:00.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1732313749 >> 172.21.15.82:0/1732313749 conn(0x7f0d680adc40 msgr2=0x7f0d680a9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:00.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1732313749 shutdown_connections 2020-04-02T23:47:00.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.488+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1732313749 wait complete. 2020-04-02T23:47:00.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.489+0000 7f0d6ff73700 1 Processor -- start 2020-04-02T23:47:00.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.489+0000 7f0d6ff73700 1 -- start start 2020-04-02T23:47:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6ff73700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d68136860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6ff73700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d6813cdc0 0x7f0d68146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6ff73700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d681357f0 con 0x7f0d680aa560 2020-04-02T23:47:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6ff73700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d681463a0 con 0x7f0d6813cdc0 2020-04-02T23:47:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6ff73700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68146640 con 0x7f0d6805f4f0 2020-04-02T23:47:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6d50e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0d680aa560 0x7f0d68138890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54030/0 (socket says 172.21.15.82:54030) 2020-04-02T23:47:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d6813cdc0 0x7f0d68146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6d50e700 1 -- 172.21.15.82:0/1409774180 learned_addr learned my addr 172.21.15.82:0/1409774180 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d68136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295854862 0 0) 0x7f0d681357f0 con 0x7f0d680aa560 2020-04-02T23:47:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d48002fe0 con 0x7f0d680aa560 2020-04-02T23:47:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 -- 172.21.15.82:0/1409774180 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 msgr2=0x7f0d68136860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d68136860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 -- 172.21.15.82:0/1409774180 >> v1:172.21.15.82:6789/0 conn(0x7f0d680aa560 legacy=0x7f0d68138890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 -- 172.21.15.82:0/1409774180 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d681468e0 con 0x7f0d6813cdc0 2020-04-02T23:47:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> v2:172.21.15.82:3300/0 conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> v2:172.21.15.82:3300/0 conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d60012a80 con 0x7f0d6813cdc0 2020-04-02T23:47:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.490+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.491+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d60009e90 con 0x7f0d6813cdc0 2020-04-02T23:47:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.491+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d681471e0 con 0x7f0d6813cdc0 2020-04-02T23:47:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.491+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d60012e10 con 0x7f0d6813cdc0 2020-04-02T23:47:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.491+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d68135340 con 0x7f0d6813cdc0 2020-04-02T23:47:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.491+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0d60005a40 con 0x7f0d6813cdc0 2020-04-02T23:47:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d68056c50 con 0x7f0d6813cdc0 2020-04-02T23:47:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d56ffd700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 0x7f0d4804fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5863+0+0 (secure 0 0 0) 0x7f0d60061100 con 0x7f0d6813cdc0 2020-04-02T23:47:00.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 0x7f0d4804fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:00.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 0x7f0d4804fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 0x7f0d4804fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.492+0000 7f0d6dd0f700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 0x7f0d4804fdb0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:00.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.495+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:00.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.495+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f0d6003c860 con 0x7f0d6813cdc0 2020-04-02T23:47:00.634 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:00.632+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f0d6805d150 con 0x7f0d6813cdc0 2020-04-02T23:47:01.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:01.491+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.312+0000 7f0d6e510700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.313+0000 7f0d56ffd700 1 -- 172.21.15.82:0/1409774180 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v23) v1 ==== 188+0+0 (secure 0 0 0) 0x7f0d6003fe80 con 0x7f0d6813cdc0 2020-04-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 msgr2=0x7f0d4804fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 0x7f0d4804fdb0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f0d68062520 tx=0x7f0d58007a40).stop 2020-04-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 msgr2=0x7f0d68146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0d600032b0 tx=0x7f0d60010cc0).stop 2020-04-02T23:47:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 shutdown_connections 2020-04-02T23:47:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d6813cdc0 0x7f0d68146d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6805f4f0 0x7f0d68136860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 --2- 172.21.15.82:0/1409774180 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0d4804d8f0 0x7f0d4804fdb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 >> 172.21.15.82:0/1409774180 conn(0x7f0d680adc40 msgr2=0x7f0d6805f980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 shutdown_connections 2020-04-02T23:47:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.316+0000 7f0d6ff73700 1 -- 172.21.15.82:0/1409774180 wait complete. 2020-04-02T23:47:02.320 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2020-04-02T23:47:02.331 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:02.345 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-04-02T23:47:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.497+0000 7f45047cd700 1 Processor -- start 2020-04-02T23:47:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.497+0000 7f45047cd700 1 -- start start 2020-04-02T23:47:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.498+0000 7f45047cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44fc138d00 0x7f44fc0a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.498+0000 7f45047cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44fc139320 0x7f44fc1397d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.498+0000 7f45047cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc139c30 con 0x7f44fc0a8410 2020-04-02T23:47:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.498+0000 7f45047cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0a7410 con 0x7f44fc139320 2020-04-02T23:47:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.498+0000 7f45047cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc065310 con 0x7f44fc138d00 2020-04-02T23:47:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.498+0000 7f4502569700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f44fc0a8410 0x7f44fc065a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54040/0 (socket says 172.21.15.82:54040) 2020-04-02T23:47:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.498+0000 7f4502569700 1 -- 172.21.15.82:0/1743516553 learned_addr learned my addr 172.21.15.82:0/1743516553 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501d68700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44fc138d00 0x7f44fc0a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> v2:172.21.15.50:3300/0 conn(0x7f44fc139320 0x7f44fc1397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094622702 0 0) 0x7f44fc139c30 con 0x7f44fc0a8410 2020-04-02T23:47:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e4003230 con 0x7f44fc0a8410 2020-04-02T23:47:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 62402643 0 0) 0x7f44e4003230 con 0x7f44fc0a8410 2020-04-02T23:47:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44fc138d00 msgr2=0x7f44fc0a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44fc138d00 0x7f44fc0a6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 >> v2:172.21.15.50:3300/0 conn(0x7f44fc139320 msgr2=0x7f44fc1397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 --2- 172.21.15.82:0/1743516553 >> v2:172.21.15.50:3300/0 conn(0x7f44fc139320 0x7f44fc1397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0655b0 con 0x7f44fc0a8410 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f44f80016d0 con 0x7f44fc0a8410 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 >> v1:172.21.15.82:6789/0 conn(0x7f44fc0a8410 legacy=0x7f44fc065a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44e4003720 0x7f44e4003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e4003f60 0x7f44e40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0a7410 con 0x7f44e4003f60 2020-04-02T23:47:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc065310 con 0x7f44e4004980 2020-04-02T23:47:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e400b720 con 0x7f44e4003720 2020-04-02T23:47:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502569700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44e4003720 0x7f44e4003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501d68700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e4003f60 0x7f44e40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 -- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44e4003720 msgr2=0x7f44e4003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44e4003720 0x7f44e4003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 -- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e4003f60 msgr2=0x7f44e40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e4003f60 0x7f44e40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 -- 172.21.15.82:0/1743516553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4003230 con 0x7f44e4004980 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44f40032b0 tx=0x7f44f40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44f40032b0 tx=0x7f44f40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f44f40032b0 tx=0x7f44f40103a0).ready entity=mon.1 client_cookie=556dff3afb685648 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f44f40032b0 tx=0x7f44f40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f44f40032b0 tx=0x7f44f40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.499+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f40112b0 con 0x7f44e4004980 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f4502d6a700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f44f40032b0 tx=0x7f44f40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4011410 con 0x7f44e4004980 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f4501567700 1 -- 172.21.15.82:0/1743516553 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f40117f0 con 0x7f44e4004980 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f45047cd700 1 -- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 msgr2=0x7f44e4004e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f45047cd700 1 --2- 172.21.15.82:0/1743516553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4004980 0x7f44e4004e00 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f44f40032b0 tx=0x7f44f40103a0).stop 2020-04-02T23:47:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f4502d6a700 1 -- 172.21.15.82:0/1743516553 reap_dead start 2020-04-02T23:47:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f45047cd700 1 -- 172.21.15.82:0/1743516553 shutdown_connections 2020-04-02T23:47:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f45047cd700 1 -- 172.21.15.82:0/1743516553 >> 172.21.15.82:0/1743516553 conn(0x7f44fc0ab970 msgr2=0x7f44fc0a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f45047cd700 1 -- 172.21.15.82:0/1743516553 shutdown_connections 2020-04-02T23:47:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.500+0000 7f45047cd700 1 -- 172.21.15.82:0/1743516553 wait complete. 2020-04-02T23:47:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.501+0000 7f45047cd700 1 Processor -- start 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.501+0000 7f45047cd700 1 -- start start 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.501+0000 7f45047cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44fc13bb80 0x7f44fc146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.501+0000 7f45047cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44fc146f20 0x7f44fc135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.501+0000 7f45047cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc0a11b0 con 0x7f44fc135fa0 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.501+0000 7f45047cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc1466a0 con 0x7f44fc146f20 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.501+0000 7f45047cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0a1450 con 0x7f44fc13bb80 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44fc13bb80 0x7f44fc146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44fc13bb80 0x7f44fc146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53998/0 (socket says 172.21.15.82:53998) 2020-04-02T23:47:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 -- 172.21.15.82:0/3902452517 learned_addr learned my addr 172.21.15.82:0/3902452517 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4501d68700 1 --2- 172.21.15.82:0/3902452517 >> v2:172.21.15.50:3300/0 conn(0x7f44fc146f20 0x7f44fc135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 -- 172.21.15.82:0/3902452517 >> v2:172.21.15.50:3300/0 conn(0x7f44fc146f20 msgr2=0x7f44fc135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> v2:172.21.15.50:3300/0 conn(0x7f44fc146f20 0x7f44fc135b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088779683 0 0) 0x7f44fc0a11b0 con 0x7f44fc135fa0 2020-04-02T23:47:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 -- 172.21.15.82:0/3902452517 >> v1:172.21.15.82:6789/0 conn(0x7f44fc135fa0 legacy=0x7f44fc149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 -- 172.21.15.82:0/3902452517 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc09e750 con 0x7f44fc13bb80 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> v2:172.21.15.82:3300/0 conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> v2:172.21.15.82:3300/0 conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f800cbe0 con 0x7f44fc13bb80 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800cd40 con 0x7f44fc13bb80 2020-04-02T23:47:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f8011970 con 0x7f44fc13bb80 2020-04-02T23:47:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc1473b0 con 0x7f44fc13bb80 2020-04-02T23:47:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.502+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc0a0830 con 0x7f44fc13bb80 2020-04-02T23:47:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.503+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.503+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f44f8011be0 con 0x7f44fc13bb80 2020-04-02T23:47:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.503+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.503+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc1365c0 con 0x7f44fc13bb80 2020-04-02T23:47:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.503+0000 7f44eb7fe700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 0x7f44dc04f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.503+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f44f8060a50 con 0x7f44fc13bb80 2020-04-02T23:47:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.503+0000 7f4501d68700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 0x7f44dc04f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.504+0000 7f4501d68700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 0x7f44dc04f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44ec002f30 tx=0x7f44ec003030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.504+0000 7f4501d68700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 0x7f44dc04f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44ec002f30 tx=0x7f44ec003030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.504+0000 7f4501d68700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 0x7f44dc04f920 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f44ec002f30 tx=0x7f44ec003030).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:02.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.507+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:02.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.507+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f44f803c270 con 0x7f44fc13bb80 2020-04-02T23:47:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:02.645+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f44fc056c50 con 0x7f44fc13bb80 2020-04-02T23:47:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.314+0000 7f4502569700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.314+0000 7f44eb7fe700 1 -- 172.21.15.82:0/3902452517 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 166+0+0 (secure 0 0 0) 0x7f44f803f890 con 0x7f44fc13bb80 2020-04-02T23:47:03.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.316+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 msgr2=0x7f44dc04f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.316+0000 7f45047cd700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 0x7f44dc04f920 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f44ec002f30 tx=0x7f44ec003030).stop 2020-04-02T23:47:03.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.316+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 msgr2=0x7f44fc146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.316+0000 7f45047cd700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f44f80013e0 tx=0x7f44fc0a87f0).stop 2020-04-02T23:47:03.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.317+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 shutdown_connections 2020-04-02T23:47:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.317+0000 7f45047cd700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f44dc04d460 0x7f44dc04f920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.317+0000 7f45047cd700 1 --2- 172.21.15.82:0/3902452517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc13bb80 0x7f44fc146ac0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.317+0000 7f45047cd700 1 --2- 172.21.15.82:0/3902452517 >> v2:172.21.15.50:3300/0 conn(0x7f44fc146f20 0x7f44fc135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.317+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 >> 172.21.15.82:0/3902452517 conn(0x7f44fc0ab970 msgr2=0x7f44fc0a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.317+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 shutdown_connections 2020-04-02T23:47:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.317+0000 7f45047cd700 1 -- 172.21.15.82:0/3902452517 wait complete. 2020-04-02T23:47:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:set pool 4 allow_ec_overwrites to true 2020-04-02T23:47:03.333 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:03.348 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-02T23:47:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.500+0000 7f2518254700 1 Processor -- start 2020-04-02T23:47:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.500+0000 7f2518254700 1 -- start start 2020-04-02T23:47:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2518254700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25100a3320 0x7f25100a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2518254700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a5f90 0x7f25100a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2518254700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25100a2460 con 0x7f2510066b00 2020-04-02T23:47:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2518254700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25100a4270 con 0x7f25100a3320 2020-04-02T23:47:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2518254700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25100a3b50 con 0x7f25100a5f90 2020-04-02T23:47:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25100a3320 0x7f25100a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f25167f1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2510066b00 0x7f2510066f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54060/0 (socket says 172.21.15.82:54060) 2020-04-02T23:47:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f25167f1700 1 -- 172.21.15.82:0/3029966735 learned_addr learned my addr 172.21.15.82:0/3029966735 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f25157ef700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a5f90 0x7f25100a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 -- 172.21.15.82:0/3029966735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a5f90 msgr2=0x7f25100a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a5f90 0x7f25100a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 -- 172.21.15.82:0/3029966735 >> v1:172.21.15.82:6789/0 conn(0x7f2510066b00 legacy=0x7f2510066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2514fee700 1 -- 172.21.15.82:0/3029966735 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041629561 0 0) 0x7f25100a2460 con 0x7f2510066b00 2020-04-02T23:47:03.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 -- 172.21.15.82:0/3029966735 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100a5850 con 0x7f25100a3320 2020-04-02T23:47:03.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f25157ef700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a5f90 0x7f25100a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:03.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- 172.21.15.82:0/3029966735 >> v2:172.21.15.82:3300/0 conn(0x7f25100a3320 0x7f25100a4fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2500002f30 tx=0x7f2500007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- 172.21.15.82:0/3029966735 >> v2:172.21.15.82:3300/0 conn(0x7f25100a3320 0x7f25100a4fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2500002f30 tx=0x7f2500007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25100a3320 0x7f25100a4fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f2500002f30 tx=0x7f2500007a40).ready entity=mon.1 client_cookie=19af0d32005ac273 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:03.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25100a3320 0x7f25100a4fc0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2500002f30 tx=0x7f2500007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2514fee700 1 -- 172.21.15.82:0/3029966735 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2500011470 con 0x7f25100a3320 2020-04-02T23:47:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25100a3320 0x7f25100a4fc0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2500002f30 tx=0x7f2500007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2514fee700 1 -- 172.21.15.82:0/3029966735 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25000115d0 con 0x7f25100a3320 2020-04-02T23:47:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.501+0000 7f2515ff0700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25100a3320 0x7f25100a4fc0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2500002f30 tx=0x7f2500007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2514fee700 1 -- 172.21.15.82:0/3029966735 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25000119b0 con 0x7f25100a3320 2020-04-02T23:47:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 -- 172.21.15.82:0/3029966735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25100a3320 msgr2=0x7f25100a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25100a3320 0x7f25100a4fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f2500002f30 tx=0x7f2500007a40).stop 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 -- 172.21.15.82:0/3029966735 shutdown_connections 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25100a3320 0x7f25100a4fc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 --2- 172.21.15.82:0/3029966735 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a5f90 0x7f25100a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 -- 172.21.15.82:0/3029966735 >> 172.21.15.82:0/3029966735 conn(0x7f25100ab970 msgr2=0x7f25100a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 -- 172.21.15.82:0/3029966735 shutdown_connections 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.502+0000 7f2518254700 1 -- 172.21.15.82:0/3029966735 wait complete. 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.503+0000 7f2518254700 1 Processor -- start 2020-04-02T23:47:03.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.503+0000 7f2518254700 1 -- start start 2020-04-02T23:47:03.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f2518254700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a3320 0x7f251012cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:03.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f2518254700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25100a5f90 0x7f2510138130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:03.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f2518254700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25100a2620 con 0x7f2510066b00 2020-04-02T23:47:03.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f2518254700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2510138590 con 0x7f25100a5f90 2020-04-02T23:47:03.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f2518254700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2510137910 con 0x7f25100a3320 2020-04-02T23:47:03.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25157ef700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a3320 0x7f251012cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25100a5f90 0x7f2510138130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25157ef700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a3320 0x7f251012cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:49720/0 (socket says 172.21.15.82:49720) 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25157ef700 1 -- 172.21.15.82:0/1563903509 learned_addr learned my addr 172.21.15.82:0/1563903509 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 -- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a3320 msgr2=0x7f251012cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a3320 0x7f251012cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 -- 172.21.15.82:0/1563903509 >> v1:172.21.15.50:6789/0 conn(0x7f2510066b00 legacy=0x7f251009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 -- 172.21.15.82:0/1563903509 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251012d3d0 con 0x7f25100a5f90 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25157ef700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a3320 0x7f251012cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:03.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> v2:172.21.15.50:3300/0 conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> v2:172.21.15.50:3300/0 conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.504+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:03.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f24feffd700 1 -- 172.21.15.82:0/1563903509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2508005e30 con 0x7f25100a5f90 2020-04-02T23:47:03.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f24feffd700 1 -- 172.21.15.82:0/1563903509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508012490 con 0x7f25100a5f90 2020-04-02T23:47:03.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251012d670 con 0x7f25100a5f90 2020-04-02T23:47:03.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f24feffd700 1 -- 172.21.15.82:0/1563903509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25080128b0 con 0x7f25100a5f90 2020-04-02T23:47:03.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251009e340 con 0x7f25100a5f90 2020-04-02T23:47:03.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.505+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251012dad0 con 0x7f25100a5f90 2020-04-02T23:47:03.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f24feffd700 1 -- 172.21.15.82:0/1563903509 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2508012b70 con 0x7f25100a5f90 2020-04-02T23:47:03.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f24feffd700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 0x7f24f004f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f24feffd700 1 -- 172.21.15.82:0/1563903509 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f2508061540 con 0x7f25100a5f90 2020-04-02T23:47:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f2515ff0700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 0x7f24f004f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f2515ff0700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 0x7f24f004f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f251012dc90 tx=0x7f2500007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f2515ff0700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 0x7f24f004f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f251012dc90 tx=0x7f2500007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.506+0000 7f2515ff0700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 0x7f24f004f960 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f251012dc90 tx=0x7f2500007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.510+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.510+0000 7f24feffd700 1 -- 172.21.15.82:0/1563903509 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f250803cbc0 con 0x7f25100a5f90 2020-04-02T23:47:03.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.692+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2510056c50 con 0x7f25100a5f90 2020-04-02T23:47:03.695 INFO:tasks.ceph.mon.b.smithi050.stderr:2020-04-02T23:47:03.693+0000 7f1f82194700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-02T23:47:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.697+0000 7f25167f1700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.697+0000 7f24feffd700 1 -- 172.21.15.82:0/1563903509 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f25080401e0 con 0x7f25100a5f90 2020-04-02T23:47:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 msgr2=0x7f24f004f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 0x7f24f004f960 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f251012dc90 tx=0x7f2500007a40).stop 2020-04-02T23:47:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 msgr2=0x7f2510138130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f2508001210 tx=0x7f2508010c00).stop 2020-04-02T23:47:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 shutdown_connections 2020-04-02T23:47:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f24f004d4a0 0x7f24f004f960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25100a5f90 0x7f2510138130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 --2- 172.21.15.82:0/1563903509 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f25100a3320 0x7f251012cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 >> 172.21.15.82:0/1563903509 conn(0x7f25100ab970 msgr2=0x7f251005b010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:03.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 shutdown_connections 2020-04-02T23:47:03.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.700+0000 7f2518254700 1 -- 172.21.15.82:0/1563903509 wait complete. 2020-04-02T23:47:03.704 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 3 and data pool 4 2020-04-02T23:47:03.713 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:03.726 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:03.874 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.870+0000 7f81e7bfc700 1 Processor -- start 2020-04-02T23:47:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.870+0000 7f81e7bfc700 1 -- start start 2020-04-02T23:47:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e7bfc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81e00a4b70 0x7f81e00a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e7bfc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81e0136160 0x7f81e01365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e7bfc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00a5820 con 0x7f81e00a2ab0 2020-04-02T23:47:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e7bfc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00a4130 con 0x7f81e00a4b70 2020-04-02T23:47:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e7bfc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00a43d0 con 0x7f81e0136160 2020-04-02T23:47:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81e0136160 0x7f81e01365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81e0136160 0x7f81e01365d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54022/0 (socket says 172.21.15.82:54022) 2020-04-02T23:47:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e5998700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f81e00a2ab0 0x7f81e00aae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54070/0 (socket says 172.21.15.82:54070) 2020-04-02T23:47:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 -- 172.21.15.82:0/1224503326 learned_addr learned my addr 172.21.15.82:0/1224503326 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e5197700 1 --2- 172.21.15.82:0/1224503326 >> v2:172.21.15.50:3300/0 conn(0x7f81e00a4b70 0x7f81e00a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 -- 172.21.15.82:0/1224503326 >> v2:172.21.15.50:3300/0 conn(0x7f81e00a4b70 msgr2=0x7f81e00a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- 172.21.15.82:0/1224503326 >> v2:172.21.15.50:3300/0 conn(0x7f81e00a4b70 0x7f81e00a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 -- 172.21.15.82:0/1224503326 >> v1:172.21.15.82:6789/0 conn(0x7f81e00a2ab0 legacy=0x7f81e00aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e4996700 1 -- 172.21.15.82:0/1224503326 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034852035 0 0) 0x7f81e00a5820 con 0x7f81e00a2ab0 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 -- 172.21.15.82:0/1224503326 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00a4670 con 0x7f81e0136160 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e5197700 1 --2- 172.21.15.82:0/1224503326 >> v2:172.21.15.50:3300/0 conn(0x7f81e00a4b70 0x7f81e00a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- 172.21.15.82:0/1224503326 >> v2:172.21.15.82:3300/0 conn(0x7f81e0136160 0x7f81e01365d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- 172.21.15.82:0/1224503326 >> v2:172.21.15.82:3300/0 conn(0x7f81e0136160 0x7f81e01365d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- 172.21.15.82:0/1224503326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81e0136160 0x7f81e01365d0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).ready entity=mon.1 client_cookie=b5fe52643fb0066c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- 172.21.15.82:0/1224503326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81e0136160 0x7f81e01365d0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e4996700 1 -- 172.21.15.82:0/1224503326 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc011720 con 0x7f81e0136160 2020-04-02T23:47:03.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- 172.21.15.82:0/1224503326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81e0136160 0x7f81e01365d0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e6199700 1 --2- 172.21.15.82:0/1224503326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81e0136160 0x7f81e01365d0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e4996700 1 -- 172.21.15.82:0/1224503326 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc011880 con 0x7f81e0136160 2020-04-02T23:47:03.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e4996700 1 -- 172.21.15.82:0/1224503326 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc011c20 con 0x7f81e0136160 2020-04-02T23:47:03.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e7bfc700 1 -- 172.21.15.82:0/1224503326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81e0136160 msgr2=0x7f81e01365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.871+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/1224503326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81e0136160 0x7f81e01365d0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).stop 2020-04-02T23:47:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.872+0000 7f81e7bfc700 1 -- 172.21.15.82:0/1224503326 shutdown_connections 2020-04-02T23:47:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.872+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/1224503326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81e0136160 0x7f81e01365d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.872+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/1224503326 >> v2:172.21.15.50:3300/0 conn(0x7f81e00a4b70 0x7f81e00a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.872+0000 7f81e7bfc700 1 -- 172.21.15.82:0/1224503326 >> 172.21.15.82:0/1224503326 conn(0x7f81e009de60 msgr2=0x7f81e009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.872+0000 7f81e7bfc700 1 -- 172.21.15.82:0/1224503326 shutdown_connections 2020-04-02T23:47:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.872+0000 7f81e7bfc700 1 -- 172.21.15.82:0/1224503326 wait complete. 2020-04-02T23:47:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.873+0000 7f81e7bfc700 1 Processor -- start 2020-04-02T23:47:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.873+0000 7f81e7bfc700 1 -- start start 2020-04-02T23:47:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.873+0000 7f81e7bfc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81e00a2ab0 0x7f81e00a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.873+0000 7f81e7bfc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81e0136160 0x7f81e014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.873+0000 7f81e7bfc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00aab10 con 0x7f81e00a4b70 2020-04-02T23:47:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.873+0000 7f81e7bfc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e0066e80 con 0x7f81e00a2ab0 2020-04-02T23:47:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.873+0000 7f81e7bfc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0064a80 con 0x7f81e0136160 2020-04-02T23:47:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81e00a2ab0 0x7f81e00a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e6199700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81e0136160 0x7f81e014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5197700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81e00a4b70 0x7f81e0062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58046/0 (socket says 172.21.15.82:58046) 2020-04-02T23:47:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5197700 1 -- 172.21.15.82:0/2895346171 learned_addr learned my addr 172.21.15.82:0/2895346171 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 -- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81e0136160 msgr2=0x7f81e014e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81e0136160 0x7f81e014e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 -- 172.21.15.82:0/2895346171 >> v1:172.21.15.50:6789/0 conn(0x7f81e00a4b70 legacy=0x7f81e0062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448872832 0 0) 0x7f81e00aab10 con 0x7f81e00a4b70 2020-04-02T23:47:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 -- 172.21.15.82:0/2895346171 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0063460 con 0x7f81e00a2ab0 2020-04-02T23:47:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e6199700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81e0136160 0x7f81e014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> v2:172.21.15.50:3300/0 conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> v2:172.21.15.50:3300/0 conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d8004c50 con 0x7f81e00a2ab0 2020-04-02T23:47:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e00a2100 con 0x7f81e00a2ab0 2020-04-02T23:47:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.874+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8004db0 con 0x7f81e00a2ab0 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.875+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.875+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d80125c0 con 0x7f81e00a2ab0 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.875+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e0135b70 con 0x7f81e00a2ab0 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.875+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.875+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e00a1d50 con 0x7f81e00a2ab0 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f81d8012720 con 0x7f81e00a2ab0 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81d2ffd700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 0x7f81c004f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f81d8061140 con 0x7f81e00a2ab0 2020-04-02T23:47:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81e5197700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 0x7f81c004f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81e5197700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 0x7f81c004f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81d4003070 tx=0x7f81d4002550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81e5197700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 0x7f81c004f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81d4003070 tx=0x7f81d4002550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.876+0000 7f81e5197700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 0x7f81c004f960 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f81d4003070 tx=0x7f81d4002550).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.880+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:03.880+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f81e00a1d50 con 0x7f81e00a2ab0 2020-04-02T23:47:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.018+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81e00a1d50 con 0x7f81e00a2ab0 2020-04-02T23:47:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.020+0000 7f81e5998700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.020+0000 7f81d2ffd700 1 -- 172.21.15.82:0/2895346171 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16312 (secure 0 0 0) 0x7f81e00a1d50 con 0x7f81e00a2ab0 2020-04-02T23:47:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.021+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 msgr2=0x7f81c004f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.021+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 0x7f81c004f960 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f81d4003070 tx=0x7f81d4002550).stop 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.021+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 msgr2=0x7f81e00a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.021+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f81d8000f00 tx=0x7f81d8010c20).stop 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.021+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 shutdown_connections 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.021+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f81c004d4a0 0x7f81c004f960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.022+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f81e0136160 0x7f81e014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.022+0000 7f81e7bfc700 1 --2- 172.21.15.82:0/2895346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81e00a2ab0 0x7f81e00a1730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.022+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 >> 172.21.15.82:0/2895346171 conn(0x7f81e009de60 msgr2=0x7f81e0068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:04.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.022+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 shutdown_connections 2020-04-02T23:47:04.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.022+0000 7f81e7bfc700 1 -- 172.21.15.82:0/2895346171 wait complete. 2020-04-02T23:47:04.027 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:04.027 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:03.694017+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:04.035 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:04.063 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.221+0000 7f56bb941700 1 Processor -- start 2020-04-02T23:47:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.221+0000 7f56bb941700 1 -- start start 2020-04-02T23:47:04.227 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56bb941700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b40aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:04.227 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56bb941700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56b4136870 0x7f56b40a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56bb941700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40a5820 con 0x7f56b40a4b70 2020-04-02T23:47:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56bb941700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b40a4130 con 0x7f56b40a2ab0 2020-04-02T23:47:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56bb941700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b40a43d0 con 0x7f56b4136870 2020-04-02T23:47:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b96dd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b40aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b96dd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b40aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54034/0 (socket says 172.21.15.82:54034) 2020-04-02T23:47:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b96dd700 1 -- 172.21.15.82:0/2691610825 learned_addr learned my addr 172.21.15.82:0/2691610825 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:04.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b9ede700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56b4136870 0x7f56b40a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:04.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b96dd700 1 -- 172.21.15.82:0/2691610825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56b4136870 msgr2=0x7f56b40a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:04.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b96dd700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56b4136870 0x7f56b40a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:04.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b96dd700 1 -- 172.21.15.82:0/2691610825 >> v1:172.21.15.50:6789/0 conn(0x7f56b40a4b70 legacy=0x7f56b4136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.222+0000 7f56b96dd700 1 -- 172.21.15.82:0/2691610825 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b40a4670 con 0x7f56b40a2ab0 2020-04-02T23:47:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56b96dd700 1 --2- 172.21.15.82:0/2691610825 >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b40aae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56b96dd700 1 --2- 172.21.15.82:0/2691610825 >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b40aae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56b96dd700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b40aae80 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).ready entity=mon.1 client_cookie=93f59f6bf596bc88 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56b96dd700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b40aae80 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56a3fff700 1 -- 172.21.15.82:0/2691610825 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a4011720 con 0x7f56b40a2ab0 2020-04-02T23:47:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56b96dd700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b40aae80 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56a3fff700 1 -- 172.21.15.82:0/2691610825 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4011880 con 0x7f56b40a2ab0 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56b96dd700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b40aae80 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56a3fff700 1 -- 172.21.15.82:0/2691610825 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a4011ca0 con 0x7f56b40a2ab0 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 -- 172.21.15.82:0/2691610825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 msgr2=0x7f56b40aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b40aae80 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).stop 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 -- 172.21.15.82:0/2691610825 shutdown_connections 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56b4136870 0x7f56b40a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 --2- 172.21.15.82:0/2691610825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b40aae80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 -- 172.21.15.82:0/2691610825 >> 172.21.15.82:0/2691610825 conn(0x7f56b409de60 msgr2=0x7f56b409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 -- 172.21.15.82:0/2691610825 shutdown_connections 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.223+0000 7f56bb941700 1 -- 172.21.15.82:0/2691610825 wait complete. 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.224+0000 7f56bb941700 1 Processor -- start 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.224+0000 7f56bb941700 1 -- start start 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56bb941700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b4139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56bb941700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b4066b80 con 0x7f56b4136870 2020-04-02T23:47:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56bb941700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b4138280 con 0x7f56b40a4b70 2020-04-02T23:47:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56bb941700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b4138520 con 0x7f56b40a2ab0 2020-04-02T23:47:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b4139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b4139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54040/0 (socket says 172.21.15.82:54040) 2020-04-02T23:47:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 -- 172.21.15.82:0/3743902806 learned_addr learned my addr 172.21.15.82:0/3743902806 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b8edc700 1 --1- 172.21.15.82:0/3743902806 >> v1:172.21.15.82:6789/0 conn(0x7f56b40a4b70 0x7f56b41466e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54092/0 (socket says 172.21.15.82:54092) 2020-04-02T23:47:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 -- 172.21.15.82:0/3743902806 >> v1:172.21.15.82:6789/0 conn(0x7f56b40a4b70 legacy=0x7f56b41466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 -- 172.21.15.82:0/3743902806 >> v1:172.21.15.50:6789/0 conn(0x7f56b4136870 legacy=0x7f56b4130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910932760 0 0) 0x7f56b4138280 con 0x7f56b40a4b70 2020-04-02T23:47:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 -- 172.21.15.82:0/3743902806 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b41387c0 con 0x7f56b40a2ab0 2020-04-02T23:47:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> v2:172.21.15.82:3300/0 conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.225+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a4011d90 con 0x7f56b40a2ab0 2020-04-02T23:47:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4007340 con 0x7f56b40a2ab0 2020-04-02T23:47:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b4137f00 con 0x7f56b40a2ab0 2020-04-02T23:47:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a40056c0 con 0x7f56b40a2ab0 2020-04-02T23:47:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b4066020 con 0x7f56b40a2ab0 2020-04-02T23:47:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.226+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f56a40058b0 con 0x7f56b40a2ab0 2020-04-02T23:47:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b4056c50 con 0x7f56b40a2ab0 2020-04-02T23:47:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56a27fc700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 0x7f569404f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f56a40614d0 con 0x7f56b40a2ab0 2020-04-02T23:47:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56b8edc700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 0x7f569404f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56b8edc700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 0x7f569404f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56b00012a0 tx=0x7f56b00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56b8edc700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 0x7f569404f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56b00012a0 tx=0x7f56b00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.227+0000 7f56b8edc700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 0x7f569404f8a0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f56b00012a0 tx=0x7f56b00017f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.230+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.230+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f56a403ccf0 con 0x7f56b40a2ab0 2020-04-02T23:47:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.368+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56b405d150 con 0x7f56b40a2ab0 2020-04-02T23:47:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.369+0000 7f56b96dd700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.369+0000 7f56a27fc700 1 -- 172.21.15.82:0/3743902806 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16312 (secure 0 0 0) 0x7f56a4040310 con 0x7f56b40a2ab0 2020-04-02T23:47:04.371 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:04.372 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:03.694017+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 msgr2=0x7f569404f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 0x7f569404f8a0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f56b00012a0 tx=0x7f56b00017f0).stop 2020-04-02T23:47:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 msgr2=0x7f56b4139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f56a4002f30 tx=0x7f56a4007a40).stop 2020-04-02T23:47:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 shutdown_connections 2020-04-02T23:47:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b40a2ab0 0x7f56b4139530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 --2- 172.21.15.82:0/3743902806 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f569404d3e0 0x7f569404f8a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 >> 172.21.15.82:0/3743902806 conn(0x7f56b409de60 msgr2=0x7f56b4068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 shutdown_connections 2020-04-02T23:47:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.370+0000 7f56bb941700 1 -- 172.21.15.82:0/3743902806 wait complete. 2020-04-02T23:47:04.383 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:04.399 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-02T23:47:04.547 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.546+0000 7fdf9915a700 1 Processor -- start 2020-04-02T23:47:04.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.546+0000 7fdf9915a700 1 -- start start 2020-04-02T23:47:04.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.546+0000 7fdf9915a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf940a8410 0x7fdf940a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:04.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.546+0000 7fdf9915a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf940a4e70 0x7fdf94134130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:04.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.546+0000 7fdf9915a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940a73a0 con 0x7fdf940a7590 2020-04-02T23:47:04.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.546+0000 7fdf9915a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf94134590 con 0x7fdf940a4e70 2020-04-02T23:47:04.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.546+0000 7fdf9915a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940a45a0 con 0x7fdf940a8410 2020-04-02T23:47:04.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf940a4e70 0x7fdf94134130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf940a4e70 0x7fdf94134130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54050/0 (socket says 172.21.15.82:54050) 2020-04-02T23:47:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 -- 172.21.15.82:0/934825859 learned_addr learned my addr 172.21.15.82:0/934825859 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 -- 172.21.15.82:0/934825859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf940a8410 msgr2=0x7fdf940a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf940a8410 0x7fdf940a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:04.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 -- 172.21.15.82:0/934825859 >> v1:172.21.15.50:6789/0 conn(0x7fdf940a7590 legacy=0x7fdf94133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:04.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 -- 172.21.15.82:0/934825859 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940a6c60 con 0x7fdf940a4e70 2020-04-02T23:47:04.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- 172.21.15.82:0/934825859 >> v2:172.21.15.82:3300/0 conn(0x7fdf940a4e70 0x7fdf94134130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf9405ec60 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- 172.21.15.82:0/934825859 >> v2:172.21.15.82:3300/0 conn(0x7fdf940a4e70 0x7fdf94134130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf9405ec60 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf940a4e70 0x7fdf94134130 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fdf9405ec60 tx=0x7fdf84007a40).ready entity=mon.1 client_cookie=887d635e1e1a2ab8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:04.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf940a4e70 0x7fdf94134130 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdf9405ec60 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf91d9b700 1 -- 172.21.15.82:0/934825859 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf840116e0 con 0x7fdf940a4e70 2020-04-02T23:47:04.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf940a4e70 0x7fdf94134130 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdf9405ec60 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9359e700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf940a4e70 0x7fdf94134130 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdf9405ec60 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf91d9b700 1 -- 172.21.15.82:0/934825859 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84011840 con 0x7fdf940a4e70 2020-04-02T23:47:04.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf91d9b700 1 -- 172.21.15.82:0/934825859 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf84011c60 con 0x7fdf940a4e70 2020-04-02T23:47:04.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9915a700 1 -- 172.21.15.82:0/934825859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf940a4e70 msgr2=0x7fdf94134130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.547+0000 7fdf9915a700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf940a4e70 0x7fdf94134130 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fdf9405ec60 tx=0x7fdf84007a40).stop 2020-04-02T23:47:04.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.548+0000 7fdf9915a700 1 -- 172.21.15.82:0/934825859 shutdown_connections 2020-04-02T23:47:04.558 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.548+0000 7fdf9915a700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf940a8410 0x7fdf940a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:04.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.548+0000 7fdf9915a700 1 --2- 172.21.15.82:0/934825859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf940a4e70 0x7fdf94134130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:04.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.548+0000 7fdf9915a700 1 -- 172.21.15.82:0/934825859 >> 172.21.15.82:0/934825859 conn(0x7fdf940ab970 msgr2=0x7fdf940a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:04.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.548+0000 7fdf9915a700 1 -- 172.21.15.82:0/934825859 shutdown_connections 2020-04-02T23:47:04.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.548+0000 7fdf9915a700 1 -- 172.21.15.82:0/934825859 wait complete. 2020-04-02T23:47:04.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9915a700 1 Processor -- start 2020-04-02T23:47:04.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9915a700 1 -- start start 2020-04-02T23:47:04.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9915a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:04.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9915a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf94137030 con 0x7fdf940a4e70 2020-04-02T23:47:04.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9915a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf941372d0 con 0x7fdf940a8410 2020-04-02T23:47:04.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9915a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94137570 con 0x7fdf94131600 2020-04-02T23:47:04.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdf940a8410 0x7fdf9409a690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54106/0 (socket says 172.21.15.82:54106) 2020-04-02T23:47:04.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9259c700 1 -- 172.21.15.82:0/2307009824 learned_addr learned my addr 172.21.15.82:0/2307009824 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:04.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9259c700 1 -- 172.21.15.82:0/2307009824 >> v1:172.21.15.82:6789/0 conn(0x7fdf940a8410 legacy=0x7fdf9409a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-04-02T23:47:04.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9259c700 1 -- 172.21.15.82:0/2307009824 >> v1:172.21.15.82:6789/0 conn(0x7fdf940a8410 legacy=0x7fdf9409a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-04-02T23:47:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9259c700 1 --1- 172.21.15.82:0/2307009824 >> v1:172.21.15.82:6789/0 conn(0x7fdf940a8410 0x7fdf9409a690 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2020-04-02T23:47:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9259c700 1 --1- 172.21.15.82:0/2307009824 >> v1:172.21.15.82:6789/0 conn(0x7fdf940a8410 0x7fdf9409a690 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2020-04-02T23:47:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.549+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881948899 0 0) 0x7fdf94137030 con 0x7fdf940a4e70 2020-04-02T23:47:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf78002fe0 con 0x7fdf940a4e70 2020-04-02T23:47:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 -- 172.21.15.82:0/2307009824 >> v1:172.21.15.82:6789/0 conn(0x7fdf940a8410 legacy=0x7fdf9409a690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-04-02T23:47:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 -- 172.21.15.82:0/2307009824 >> v1:172.21.15.50:6789/0 conn(0x7fdf940a4e70 legacy=0x7fdf94147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 -- 172.21.15.82:0/2307009824 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9409e5c0 con 0x7fdf94131600 2020-04-02T23:47:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf84011ce0 con 0x7fdf94131600 2020-04-02T23:47:04.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf941346d0 con 0x7fdf94131600 2020-04-02T23:47:04.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840058b0 con 0x7fdf94131600 2020-04-02T23:47:04.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf84005c10 con 0x7fdf94131600 2020-04-02T23:47:04.571 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.550+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf94148690 con 0x7fdf94131600 2020-04-02T23:47:04.571 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.551+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.571 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.551+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf94056c50 con 0x7fdf94131600 2020-04-02T23:47:04.571 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.551+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdf8400a370 con 0x7fdf94131600 2020-04-02T23:47:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.551+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.552+0000 7fdf8bfff700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 0x7fdf7804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.552+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdf84061490 con 0x7fdf94131600 2020-04-02T23:47:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.552+0000 7fdf92d9d700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 0x7fdf7804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.552+0000 7fdf92d9d700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 0x7fdf7804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf8c001260 tx=0x7fdf8c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.552+0000 7fdf92d9d700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 0x7fdf7804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf8c001260 tx=0x7fdf8c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.573 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.552+0000 7fdf92d9d700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 0x7fdf7804fd60 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fdf8c001260 tx=0x7fdf8c0019a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:04.573 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.556+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:04.573 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.556+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fdf8403cc30 con 0x7fdf94131600 2020-04-02T23:47:04.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:04.737+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf940670a0 con 0x7fdf94131600 2020-04-02T23:47:05.551 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.550+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.698+0000 7fdf9359e700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.699+0000 7fdf8bfff700 1 -- 172.21.15.82:0/2307009824 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf84040250 con 0x7fdf94131600 2020-04-02T23:47:05.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.700+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 msgr2=0x7fdf7804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.700+0000 7fdf9915a700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 0x7fdf7804fd60 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fdf8c001260 tx=0x7fdf8c0019a0).stop 2020-04-02T23:47:05.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.700+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 msgr2=0x7fdf9409e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.700+0000 7fdf9915a700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fdf9409da90 tx=0x7fdf84007a40).stop 2020-04-02T23:47:05.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.701+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 shutdown_connections 2020-04-02T23:47:05.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.701+0000 7fdf9915a700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf94131600 0x7fdf9409e0d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.701+0000 7fdf9915a700 1 --2- 172.21.15.82:0/2307009824 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdf7804d8a0 0x7fdf7804fd60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.701+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 >> 172.21.15.82:0/2307009824 conn(0x7fdf940ab970 msgr2=0x7fdf940a5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.701+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 shutdown_connections 2020-04-02T23:47:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.701+0000 7fdf9915a700 1 -- 172.21.15.82:0/2307009824 wait complete. 2020-04-02T23:47:05.716 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:05.732 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:47:05.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.880+0000 7f2dde4fc700 1 Processor -- start 2020-04-02T23:47:05.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.880+0000 7f2dde4fc700 1 -- start start 2020-04-02T23:47:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.880+0000 7f2dde4fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.880+0000 7f2dde4fc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd80a5820 con 0x7f2dd8136160 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.880+0000 7f2dde4fc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd80a4130 con 0x7f2dd80a2ab0 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.880+0000 7f2dde4fc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd80a43d0 con 0x7f2dd80a4b70 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.880+0000 7f2dd77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54062/0 (socket says 172.21.15.82:54062) 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 -- 172.21.15.82:0/2647749864 learned_addr learned my addr 172.21.15.82:0/2647749864 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 -- 172.21.15.82:0/2647749864 >> v1:172.21.15.82:6789/0 conn(0x7f2dd80a2ab0 legacy=0x7f2dd80aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 -- 172.21.15.82:0/2647749864 >> v1:172.21.15.50:6789/0 conn(0x7f2dd8136160 legacy=0x7f2dd81365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 -- 172.21.15.82:0/2647749864 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80a4670 con 0x7f2dd80a4b70 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/2647749864 >> v2:172.21.15.82:3300/0 conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2dcc002f30 tx=0x7f2dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/2647749864 >> v2:172.21.15.82:3300/0 conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2dcc002f30 tx=0x7f2dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/2647749864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc007a40).ready entity=mon.1 client_cookie=aa84b40db281b080 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/2647749864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd6ffd700 1 -- 172.21.15.82:0/2647749864 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc011720 con 0x7f2dd80a4b70 2020-04-02T23:47:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/2647749864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/2647749864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd6ffd700 1 -- 172.21.15.82:0/2647749864 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc011880 con 0x7f2dd80a4b70 2020-04-02T23:47:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dd6ffd700 1 -- 172.21.15.82:0/2647749864 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc011c60 con 0x7f2dd80a4b70 2020-04-02T23:47:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dde4fc700 1 -- 172.21.15.82:0/2647749864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd80a4b70 msgr2=0x7f2dd80a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.881+0000 7f2dde4fc700 1 --2- 172.21.15.82:0/2647749864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc007a40).stop 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.882+0000 7f2dde4fc700 1 -- 172.21.15.82:0/2647749864 shutdown_connections 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.882+0000 7f2dde4fc700 1 --2- 172.21.15.82:0/2647749864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd80a4b70 0x7f2dd80a4ff0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.882+0000 7f2dde4fc700 1 -- 172.21.15.82:0/2647749864 >> 172.21.15.82:0/2647749864 conn(0x7f2dd809de60 msgr2=0x7f2dd809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.882+0000 7f2dde4fc700 1 -- 172.21.15.82:0/2647749864 shutdown_connections 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.882+0000 7f2dde4fc700 1 -- 172.21.15.82:0/2647749864 wait complete. 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.882+0000 7f2dde4fc700 1 Processor -- start 2020-04-02T23:47:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.882+0000 7f2dde4fc700 1 -- start start 2020-04-02T23:47:05.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dde4fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2dd8136160 0x7f2dd80a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dde4fc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd8138180 con 0x7f2dd80a4b70 2020-04-02T23:47:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dde4fc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd8138420 con 0x7f2dd80a2ab0 2020-04-02T23:47:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dde4fc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd81386c0 con 0x7f2dd8136160 2020-04-02T23:47:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dd7fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2dd80a2ab0 0x7f2dd812f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54116/0 (socket says 172.21.15.82:54116) 2020-04-02T23:47:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dd7fff700 1 -- 172.21.15.82:0/3319888345 learned_addr learned my addr 172.21.15.82:0/3319888345 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2ddca99700 1 --2- 172.21.15.82:0/3319888345 >> v2:172.21.15.50:3300/0 conn(0x7f2dd8136160 0x7f2dd80a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706510349 0 0) 0x7f2dd8138420 con 0x7f2dd80a2ab0 2020-04-02T23:47:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.883+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db8002fe0 con 0x7f2dd80a2ab0 2020-04-02T23:47:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634475804 0 0) 0x7f2dd8138180 con 0x7f2dd80a4b70 2020-04-02T23:47:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd8138420 con 0x7f2dd80a4b70 2020-04-02T23:47:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 754065201 0 0) 0x7f2db8002fe0 con 0x7f2dd80a2ab0 2020-04-02T23:47:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2dd8138180 con 0x7f2dd80a2ab0 2020-04-02T23:47:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f2dc80018d0 con 0x7f2dd80a2ab0 2020-04-02T23:47:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 >> v2:172.21.15.50:3300/0 conn(0x7f2dd8136160 msgr2=0x7f2dd80a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 --2- 172.21.15.82:0/3319888345 >> v2:172.21.15.50:3300/0 conn(0x7f2dd8136160 0x7f2dd80a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 >> v1:172.21.15.82:6789/0 conn(0x7f2dd80a2ab0 legacy=0x7f2dd812f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 >> v1:172.21.15.50:6789/0 conn(0x7f2dd80a4b70 legacy=0x7f2dd8138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db8003ab0 0x7f2db8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2db8004370 0x7f2db800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd81386c0 con 0x7f2db8003ab0 2020-04-02T23:47:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8004960 con 0x7f2db8004b20 2020-04-02T23:47:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db800bc30 con 0x7f2db8004370 2020-04-02T23:47:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db8003ab0 0x7f2db8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2ddca99700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2db8004370 0x7f2db800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 -- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2db8004370 msgr2=0x7f2db800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2db8004370 0x7f2db800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 -- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db8003ab0 msgr2=0x7f2db8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db8003ab0 0x7f2db8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd81351b0 con 0x7f2db8004b20 2020-04-02T23:47:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd812f9a0 con 0x7f2db8004b20 2020-04-02T23:47:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2ddca99700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2db8004370 0x7f2db800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2ddca99700 1 -- 172.21.15.82:0/3319888345 reap_dead start 2020-04-02T23:47:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd8137f10 con 0x7f2db8004b20 2020-04-02T23:47:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.884+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc8011b90 con 0x7f2db8004b20 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.885+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8011cf0 con 0x7f2db8004b20 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.885+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc8011ea0 con 0x7f2db8004b20 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.885+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.885+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db4003340 con 0x7f2db8004b20 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.885+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2dc8010390 con 0x7f2db8004b20 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.885+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.886+0000 7f2dd57fa700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 0x7f2db80539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.886+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2dc80611d0 con 0x7f2db8004b20 2020-04-02T23:47:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.886+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 0x7f2db80539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.886+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 0x7f2db80539e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dcc007ed0 tx=0x7f2dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.886+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 0x7f2db80539e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dcc007ed0 tx=0x7f2dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.886+0000 7f2dd77fe700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 0x7f2db80539e0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f2dcc007ed0 tx=0x7f2dcc007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.889+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:05.889+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f2dc803c930 con 0x7f2db8004b20 2020-04-02T23:47:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.074+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2db40036e0 con 0x7f2db8004b20 2020-04-02T23:47:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.074+0000 7f2dd7fff700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.074+0000 7f2dd57fa700 1 -- 172.21.15.82:0/3319888345 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f2dc803ff50 con 0x7f2db8004b20 2020-04-02T23:47:06.076 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:06.077 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:47:05.696875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:47:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 msgr2=0x7f2db80539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 0x7f2db80539e0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f2dcc007ed0 tx=0x7f2dcc007a40).stop 2020-04-02T23:47:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 msgr2=0x7f2db8004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f2dd8138310 tx=0x7f2dc8011370).stop 2020-04-02T23:47:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 shutdown_connections 2020-04-02T23:47:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2db8051520 0x7f2db80539e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 --2- 172.21.15.82:0/3319888345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db8004b20 0x7f2db8004f20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.075+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 >> 172.21.15.82:0/3319888345 conn(0x7f2dd809de60 msgr2=0x7f2dd8068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.076+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 shutdown_connections 2020-04-02T23:47:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.076+0000 7f2dde4fc700 1 -- 172.21.15.82:0/3319888345 wait complete. 2020-04-02T23:47:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2020-04-02T23:47:06.088 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:06.101 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:06.245 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.243+0000 7f10a76c5700 1 Processor -- start 2020-04-02T23:47:06.245 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.243+0000 7f10a76c5700 1 -- start start 2020-04-02T23:47:06.248 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a76c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10a00a2ab0 0x7f10a00aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:06.248 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a76c5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a4b70 0x7f10a00a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:06.248 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a76c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00a5820 con 0x7f10a0136160 2020-04-02T23:47:06.248 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a76c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00a4130 con 0x7f10a00a2ab0 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a76c5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00a43d0 con 0x7f10a00a4b70 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a5461700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10a00a2ab0 0x7f10a00aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a5461700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10a00a2ab0 0x7f10a00aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54080/0 (socket says 172.21.15.82:54080) 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a5461700 1 -- 172.21.15.82:0/694517493 learned_addr learned my addr 172.21.15.82:0/694517493 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a4c60700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a4b70 0x7f10a00a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a5461700 1 -- 172.21.15.82:0/694517493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a4b70 msgr2=0x7f10a00a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.244+0000 7f10a5461700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a4b70 0x7f10a00a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:06.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 -- 172.21.15.82:0/694517493 >> v1:172.21.15.50:6789/0 conn(0x7f10a0136160 legacy=0x7f10a01365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 -- 172.21.15.82:0/694517493 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00a4670 con 0x7f10a00a2ab0 2020-04-02T23:47:06.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 --2- 172.21.15.82:0/694517493 >> v2:172.21.15.82:3300/0 conn(0x7f10a00a2ab0 0x7f10a00aae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1090002f30 tx=0x7f1090007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 --2- 172.21.15.82:0/694517493 >> v2:172.21.15.82:3300/0 conn(0x7f10a00a2ab0 0x7f10a00aae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1090002f30 tx=0x7f1090007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a2ab0 0x7f10a00aae80 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).ready entity=mon.1 client_cookie=a444eb14c03a271d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:06.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a2ab0 0x7f10a00aae80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f108ffff700 1 -- 172.21.15.82:0/694517493 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1090011670 con 0x7f10a00a2ab0 2020-04-02T23:47:06.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a2ab0 0x7f10a00aae80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a5461700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a2ab0 0x7f10a00aae80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f108ffff700 1 -- 172.21.15.82:0/694517493 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10900117d0 con 0x7f10a00a2ab0 2020-04-02T23:47:06.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f108ffff700 1 -- 172.21.15.82:0/694517493 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1090011bf0 con 0x7f10a00a2ab0 2020-04-02T23:47:06.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 -- 172.21.15.82:0/694517493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a2ab0 msgr2=0x7f10a00aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a2ab0 0x7f10a00aae80 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).stop 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 -- 172.21.15.82:0/694517493 shutdown_connections 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a2ab0 0x7f10a00aae80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 --2- 172.21.15.82:0/694517493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a4b70 0x7f10a00a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 -- 172.21.15.82:0/694517493 >> 172.21.15.82:0/694517493 conn(0x7f10a009de60 msgr2=0x7f10a009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 -- 172.21.15.82:0/694517493 shutdown_connections 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.245+0000 7f10a76c5700 1 -- 172.21.15.82:0/694517493 wait complete. 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.246+0000 7f10a76c5700 1 Processor -- start 2020-04-02T23:47:06.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.246+0000 7f10a76c5700 1 -- start start 2020-04-02T23:47:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a76c5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a2ab0 0x7f10a01349a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a76c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10a00a4b70 0x7f10a0134e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a76c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10a0136160 0x7f10a0149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a76c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a0135260 con 0x7f10a0136160 2020-04-02T23:47:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a76c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a012fcd0 con 0x7f10a00a4b70 2020-04-02T23:47:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a76c5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a012ff70 con 0x7f10a00a2ab0 2020-04-02T23:47:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10a00a4b70 0x7f10a0134e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10a00a4b70 0x7f10a0134e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54088/0 (socket says 172.21.15.82:54088) 2020-04-02T23:47:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 -- 172.21.15.82:0/3247636332 learned_addr learned my addr 172.21.15.82:0/3247636332 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a5461700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a2ab0 0x7f10a01349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a5c62700 1 --2- 172.21.15.82:0/3247636332 >> v2:172.21.15.50:3300/0 conn(0x7f10a0136160 0x7f10a0149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 -- 172.21.15.82:0/3247636332 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a2ab0 msgr2=0x7f10a01349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a2ab0 0x7f10a01349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 -- 172.21.15.82:0/3247636332 >> v2:172.21.15.50:3300/0 conn(0x7f10a0136160 msgr2=0x7f10a0149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> v2:172.21.15.50:3300/0 conn(0x7f10a0136160 0x7f10a0149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 -- 172.21.15.82:0/3247636332 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0130210 con 0x7f10a00a4b70 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> v2:172.21.15.82:3300/0 conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> v2:172.21.15.82:3300/0 conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f108e7fc700 1 -- 172.21.15.82:0/3247636332 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f109c007540 con 0x7f10a00a4b70 2020-04-02T23:47:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f108e7fc700 1 -- 172.21.15.82:0/3247636332 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c0059c0 con 0x7f10a00a4b70 2020-04-02T23:47:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a00a1ca0 con 0x7f10a00a4b70 2020-04-02T23:47:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.247+0000 7f108e7fc700 1 -- 172.21.15.82:0/3247636332 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f109c005da0 con 0x7f10a00a4b70 2020-04-02T23:47:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.248+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a00a1f60 con 0x7f10a00a4b70 2020-04-02T23:47:06.260 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.248+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a00aa960 con 0x7f10a00a4b70 2020-04-02T23:47:06.260 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.249+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.260 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.249+0000 7f108e7fc700 1 -- 172.21.15.82:0/3247636332 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f109c008970 con 0x7f10a00a4b70 2020-04-02T23:47:06.260 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.249+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.260 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.250+0000 7f108e7fc700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 0x7f108004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:06.260 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.250+0000 7f108e7fc700 1 -- 172.21.15.82:0/3247636332 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f109c061130 con 0x7f10a00a4b70 2020-04-02T23:47:06.261 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.250+0000 7f10a5461700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 0x7f108004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.261 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.250+0000 7f10a5461700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 0x7f108004fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.261 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.250+0000 7f10a5461700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 0x7f108004fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.261 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.250+0000 7f10a5461700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 0x7f108004fa90 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:06.261 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.252+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.261 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.252+0000 7f108e7fc700 1 -- 172.21.15.82:0/3247636332 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f109c03c8b0 con 0x7f10a00a4b70 2020-04-02T23:47:06.392 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.390+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10a00aa960 con 0x7f10a00a4b70 2020-04-02T23:47:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.391+0000 7f10a4c60700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.391+0000 7f108e7fc700 1 -- 172.21.15.82:0/3247636332 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f10a00aa960 con 0x7f10a00a4b70 2020-04-02T23:47:06.393 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 msgr2=0x7f108004fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 0x7f108004fa90 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1090002f30 tx=0x7f1090007a40).stop 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 msgr2=0x7f10a0134e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f109c003070 tx=0x7f109c010cc0).stop 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 shutdown_connections 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f108004d5d0 0x7f108004fa90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 --2- 172.21.15.82:0/3247636332 >> v2:172.21.15.50:3300/0 conn(0x7f10a0136160 0x7f10a0149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10a00a2ab0 0x7f10a01349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 --2- 172.21.15.82:0/3247636332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a00a4b70 0x7f10a0134e00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 >> 172.21.15.82:0/3247636332 conn(0x7f10a009de60 msgr2=0x7f10a0136570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 shutdown_connections 2020-04-02T23:47:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.393+0000 7f10a76c5700 1 -- 172.21.15.82:0/3247636332 wait complete. 2020-04-02T23:47:06.406 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-02T23:47:06.406 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-02T23:47:06.406 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:06.423 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-02T23:47:06.465 INFO:tasks.ceph.mds.b:Started 2020-04-02T23:47:06.465 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-02T23:47:06.465 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:06.478 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-02T23:47:06.521 INFO:tasks.ceph.mds.a:Started 2020-04-02T23:47:06.521 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:06.522 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-02T23:47:06.535 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:06.553 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2020-04-02T23:47:06.594 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2020-04-02T23:47:06.681 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.679+0000 7fbcf86ac700 1 Processor -- start 2020-04-02T23:47:06.681 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.679+0000 7fbcf86ac700 1 -- start start 2020-04-02T23:47:06.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf86ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:06.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf86ac700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf00a2200 con 0x7fbcf00a49a0 2020-04-02T23:47:06.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf86ac700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf0066d20 con 0x7fbcf013f360 2020-04-02T23:47:06.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf86ac700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf013a740 con 0x7fbcf0137240 2020-04-02T23:47:06.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf6c49700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbcf013f360 0x7fbcf0141750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54160/0 (socket says 172.21.15.82:54160) 2020-04-02T23:47:06.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf6c49700 1 -- 172.21.15.82:0/4073059259 learned_addr learned my addr 172.21.15.82:0/4073059259 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5446700 1 -- 172.21.15.82:0/4073059259 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372530899 0 0) 0x7fbcf0066d20 con 0x7fbcf013f360 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5446700 1 -- 172.21.15.82:0/4073059259 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd8003230 con 0x7fbcf013f360 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5446700 1 -- 172.21.15.82:0/4073059259 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758502641 0 0) 0x7fbcf00a2200 con 0x7fbcf00a49a0 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 -- 172.21.15.82:0/4073059259 >> v1:172.21.15.82:6789/0 conn(0x7fbcf013f360 legacy=0x7fbcf0141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 -- 172.21.15.82:0/4073059259 >> v1:172.21.15.50:6789/0 conn(0x7fbcf00a49a0 legacy=0x7fbcf013a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 -- 172.21.15.82:0/4073059259 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00a1bb0 con 0x7fbcf0137240 2020-04-02T23:47:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbcec002f30 tx=0x7fbcec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbcec002f30 tx=0x7fbcec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fbcec002f30 tx=0x7fbcec0088e0).ready entity=mon.2 client_cookie=32cc498fb8b2ab08 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbcec002f30 tx=0x7fbcec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5446700 1 -- 172.21.15.82:0/4073059259 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec008e40 con 0x7fbcf0137240 2020-04-02T23:47:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.680+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbcec002f30 tx=0x7fbcec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf5446700 1 -- 172.21.15.82:0/4073059259 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0115f0 con 0x7fbcf0137240 2020-04-02T23:47:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbcec002f30 tx=0x7fbcec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf5446700 1 -- 172.21.15.82:0/4073059259 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec0119d0 con 0x7fbcf0137240 2020-04-02T23:47:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf86ac700 1 -- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 msgr2=0x7fbcf01376a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf86ac700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fbcec002f30 tx=0x7fbcec0088e0).stop 2020-04-02T23:47:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf86ac700 1 -- 172.21.15.82:0/4073059259 shutdown_connections 2020-04-02T23:47:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf86ac700 1 --2- 172.21.15.82:0/4073059259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbcf0137240 0x7fbcf01376a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf86ac700 1 -- 172.21.15.82:0/4073059259 >> 172.21.15.82:0/4073059259 conn(0x7fbcf009de60 msgr2=0x7fbcf009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf86ac700 1 -- 172.21.15.82:0/4073059259 shutdown_connections 2020-04-02T23:47:06.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.681+0000 7fbcf86ac700 1 -- 172.21.15.82:0/4073059259 wait complete. 2020-04-02T23:47:06.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.682+0000 7fbcf86ac700 1 Processor -- start 2020-04-02T23:47:06.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.682+0000 7fbcf86ac700 1 -- start start 2020-04-02T23:47:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf86ac700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbcf00a49a0 0x7fbcf013da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf86ac700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf01316e0 con 0x7fbcf013f360 2020-04-02T23:47:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf86ac700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf013d310 con 0x7fbcf0137240 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf86ac700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf013d5b0 con 0x7fbcf00a49a0 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf5c47700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbcf0137240 0x7fbcf012f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54164/0 (socket says 172.21.15.82:54164) 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf5c47700 1 -- 172.21.15.82:0/3064289601 learned_addr learned my addr 172.21.15.82:0/3064289601 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbcf00a49a0 0x7fbcf013da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167793254 0 0) 0x7fbcf013d310 con 0x7fbcf0137240 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd0002fe0 con 0x7fbcf0137240 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015379355 0 0) 0x7fbcf01316e0 con 0x7fbcf013f360 2020-04-02T23:47:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf013d310 con 0x7fbcf013f360 2020-04-02T23:47:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 -- 172.21.15.82:0/3064289601 >> v1:172.21.15.82:6789/0 conn(0x7fbcf0137240 legacy=0x7fbcf012f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 -- 172.21.15.82:0/3064289601 >> v1:172.21.15.50:6789/0 conn(0x7fbcf013f360 legacy=0x7fbcf014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 -- 172.21.15.82:0/3064289601 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00a5290 con 0x7fbcf00a49a0 2020-04-02T23:47:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> v2:172.21.15.82:3300/0 conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> v2:172.21.15.82:3300/0 conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbce0006bc0 con 0x7fbcf00a49a0 2020-04-02T23:47:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0006d60 con 0x7fbcf00a49a0 2020-04-02T23:47:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf0131400 con 0x7fbcf00a49a0 2020-04-02T23:47:06.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbce0010fe0 con 0x7fbcf00a49a0 2020-04-02T23:47:06.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.683+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0135d00 con 0x7fbcf00a49a0 2020-04-02T23:47:06.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.684+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.684+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbce0011250 con 0x7fbcf00a49a0 2020-04-02T23:47:06.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.684+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.684+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf0056c50 con 0x7fbcf00a49a0 2020-04-02T23:47:06.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.684+0000 7fbcdf7fe700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 0x7fbcd004fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.685+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbce0060d10 con 0x7fbcf00a49a0 2020-04-02T23:47:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.685+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 0x7fbcd004fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.685+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 0x7fbcd004fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbcec000b80 tx=0x7fbcf00a4d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.685+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 0x7fbcd004fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbcec000b80 tx=0x7fbcf00a4d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.685+0000 7fbcf5c47700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 0x7fbcd004fea0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fbcec000b80 tx=0x7fbcf00a4d80).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.688+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.688+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fbce003c450 con 0x7fbcf00a49a0 2020-04-02T23:47:06.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.833+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcf005d150 con 0x7fbcf00a49a0 2020-04-02T23:47:06.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.834+0000 7fbcf6448700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:06.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.834+0000 7fbcdf7fe700 1 -- 172.21.15.82:0/3064289601 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fbce0011e60 con 0x7fbcf00a49a0 2020-04-02T23:47:06.836 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:06.836 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:06.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 msgr2=0x7fbcd004fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 0x7fbcd004fea0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fbcec000b80 tx=0x7fbcf00a4d80).stop 2020-04-02T23:47:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 msgr2=0x7fbcf013da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fbce0000b80 tx=0x7fbce0010870).stop 2020-04-02T23:47:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 shutdown_connections 2020-04-02T23:47:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcf00a49a0 0x7fbcf013da50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 --2- 172.21.15.82:0/3064289601 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbcd004d9e0 0x7fbcd004fea0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 >> 172.21.15.82:0/3064289601 conn(0x7fbcf009de60 msgr2=0x7fbcf0068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:06.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 shutdown_connections 2020-04-02T23:47:06.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:06.835+0000 7fbcf86ac700 1 -- 172.21.15.82:0/3064289601 wait complete. 2020-04-02T23:47:06.848 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:42.430184+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:55.708328+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:58.921423+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:01.321018+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:47:06.848 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:06.900 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:47:07.046 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.044+0000 7fed8028b700 1 Processor -- start 2020-04-02T23:47:07.047 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.044+0000 7fed8028b700 1 -- start start 2020-04-02T23:47:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.045+0000 7fed8028b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 0x7fed780a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.045+0000 7fed8028b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed780a3960 con 0x7fed7809f610 2020-04-02T23:47:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.045+0000 7fed8028b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed780a73f0 con 0x7fed780a8410 2020-04-02T23:47:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.045+0000 7fed8028b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed780a4890 con 0x7fed78136700 2020-04-02T23:47:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.045+0000 7fed7e027700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fed780a8410 0x7fed780a3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54182/0 (socket says 172.21.15.82:54182) 2020-04-02T23:47:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.045+0000 7fed7e027700 1 -- 172.21.15.82:0/754586493 learned_addr learned my addr 172.21.15.82:0/754586493 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7e828700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 0x7fed780a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943005104 0 0) 0x7fed780a73f0 con 0x7fed780a8410 2020-04-02T23:47:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed60003230 con 0x7fed780a8410 2020-04-02T23:47:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636483887 0 0) 0x7fed780a3960 con 0x7fed7809f610 2020-04-02T23:47:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed780a73f0 con 0x7fed7809f610 2020-04-02T23:47:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 933848288 0 0) 0x7fed60003230 con 0x7fed780a8410 2020-04-02T23:47:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 msgr2=0x7fed780a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 0x7fed780a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 >> v1:172.21.15.50:6789/0 conn(0x7fed7809f610 legacy=0x7fed78135ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed780a6a40 con 0x7fed780a8410 2020-04-02T23:47:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fed680016d0 con 0x7fed780a8410 2020-04-02T23:47:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 >> v1:172.21.15.82:6789/0 conn(0x7fed780a8410 legacy=0x7fed780a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 0x7fed600038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed60004930 0x7fed60004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed780a4890 con 0x7fed60004930 2020-04-02T23:47:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60005210 con 0x7fed60003d60 2020-04-02T23:47:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6000b720 con 0x7fed78136700 2020-04-02T23:47:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7e027700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 0x7fed600038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7e828700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed60004930 0x7fed60004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 -- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 msgr2=0x7fed600038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fed78136700 0x7fed600038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 -- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed60004930 msgr2=0x7fed60004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed60004930 0x7fed60004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 -- 172.21.15.82:0/754586493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed60003230 con 0x7fed60003d60 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed740010d0 tx=0x7fed60004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed740010d0 tx=0x7fed60004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.046+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fed740010d0 tx=0x7fed60004420).ready entity=mon.1 client_cookie=84bb377cab85132e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fed740010d0 tx=0x7fed60004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed74001ac0 con 0x7fed60003d60 2020-04-02T23:47:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fed740010d0 tx=0x7fed60004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed7d826700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fed740010d0 tx=0x7fed60004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7400c950 con 0x7fed60003d60 2020-04-02T23:47:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed7d025700 1 -- 172.21.15.82:0/754586493 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed7400cd70 con 0x7fed60003d60 2020-04-02T23:47:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed8028b700 1 -- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 msgr2=0x7fed600044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed8028b700 1 --2- 172.21.15.82:0/754586493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed60003d60 0x7fed600044d0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fed740010d0 tx=0x7fed60004420).stop 2020-04-02T23:47:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed7e828700 1 -- 172.21.15.82:0/754586493 reap_dead start 2020-04-02T23:47:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed8028b700 1 -- 172.21.15.82:0/754586493 shutdown_connections 2020-04-02T23:47:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed8028b700 1 -- 172.21.15.82:0/754586493 >> 172.21.15.82:0/754586493 conn(0x7fed780ab970 msgr2=0x7fed780a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed8028b700 1 -- 172.21.15.82:0/754586493 shutdown_connections 2020-04-02T23:47:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.047+0000 7fed8028b700 1 -- 172.21.15.82:0/754586493 wait complete. 2020-04-02T23:47:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.048+0000 7fed8028b700 1 Processor -- start 2020-04-02T23:47:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.048+0000 7fed8028b700 1 -- start start 2020-04-02T23:47:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed8028b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed78062d40 0x7fed78137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed8028b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed78136bb0 con 0x7fed781390f0 2020-04-02T23:47:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed8028b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed780a18e0 con 0x7fed781381b0 2020-04-02T23:47:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed8028b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed78063120 con 0x7fed78062d40 2020-04-02T23:47:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed78062d40 0x7fed78137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7d826700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fed781381b0 0x7fed781389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54194/0 (socket says 172.21.15.82:54194) 2020-04-02T23:47:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed78062d40 0x7fed78137d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54142/0 (socket says 172.21.15.82:54142) 2020-04-02T23:47:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7d826700 1 -- 172.21.15.82:0/1264461301 learned_addr learned my addr 172.21.15.82:0/1264461301 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 -- 172.21.15.82:0/1264461301 >> v1:172.21.15.82:6789/0 conn(0x7fed781381b0 legacy=0x7fed781389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 -- 172.21.15.82:0/1264461301 >> v1:172.21.15.50:6789/0 conn(0x7fed781390f0 legacy=0x7fed78155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559591477 0 0) 0x7fed780a18e0 con 0x7fed781381b0 2020-04-02T23:47:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 -- 172.21.15.82:0/1264461301 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78060dc0 con 0x7fed78062d40 2020-04-02T23:47:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> v2:172.21.15.82:3300/0 conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> v2:172.21.15.82:3300/0 conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed68011cd0 con 0x7fed78062d40 2020-04-02T23:47:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed68011e30 con 0x7fed78062d40 2020-04-02T23:47:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed78061060 con 0x7fed78062d40 2020-04-02T23:47:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6800c8f0 con 0x7fed78062d40 2020-04-02T23:47:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.049+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed78061500 con 0x7fed78062d40 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.050+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.050+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fed6800cb60 con 0x7fed78062d40 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.050+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.050+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed780611f0 con 0x7fed78062d40 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.050+0000 7fed677fe700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 0x7fed5804f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.051+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fed68060c20 con 0x7fed78062d40 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.051+0000 7fed7d826700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 0x7fed5804f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.051+0000 7fed7d826700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 0x7fed5804f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed7400c1d0 tx=0x7fed60004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.051+0000 7fed7d826700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 0x7fed5804f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed7400c1d0 tx=0x7fed60004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.051+0000 7fed7d826700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 0x7fed5804f8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fed7400c1d0 tx=0x7fed60004420).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.054+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.054+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fed6803c380 con 0x7fed78062d40 2020-04-02T23:47:07.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.190+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fed78056c50 con 0x7fed78062d40 2020-04-02T23:47:07.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.190+0000 7fed7e027700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.190+0000 7fed677fe700 1 -- 172.21.15.82:0/1264461301 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7fed6803f9a0 con 0x7fed78062d40 2020-04-02T23:47:07.192 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2020-04-02T23:47:07.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 msgr2=0x7fed5804f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 0x7fed5804f8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fed7400c1d0 tx=0x7fed60004420).stop 2020-04-02T23:47:07.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 msgr2=0x7fed78137d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fed780a1690 tx=0x7fed780a87f0).stop 2020-04-02T23:47:07.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 shutdown_connections 2020-04-02T23:47:07.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed78062d40 0x7fed78137d50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 --2- 172.21.15.82:0/1264461301 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fed5804d430 0x7fed5804f8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 >> 172.21.15.82:0/1264461301 conn(0x7fed780ab970 msgr2=0x7fed78068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:07.195 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 shutdown_connections 2020-04-02T23:47:07.195 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.191+0000 7fed8028b700 1 -- 172.21.15.82:0/1264461301 wait complete. 2020-04-02T23:47:07.203 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:07.216 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:47:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.363+0000 7f5a58967700 1 Processor -- start 2020-04-02T23:47:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.363+0000 7f5a58967700 1 -- start start 2020-04-02T23:47:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.363+0000 7f5a58967700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a540a7590 0x7f5a54133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.372 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.363+0000 7f5a58967700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a54133e80 0x7f5a54141390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.363+0000 7f5a58967700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a540a73a0 con 0x7f5a540a8410 2020-04-02T23:47:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.363+0000 7f5a58967700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a540a45a0 con 0x7f5a540a7590 2020-04-02T23:47:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.363+0000 7f5a58967700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a540a6c60 con 0x7f5a54133e80 2020-04-02T23:47:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a54133e80 0x7f5a54141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a5259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5a540a8410 0x7f5a540a4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54200/0 (socket says 172.21.15.82:54200) 2020-04-02T23:47:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a5259c700 1 -- 172.21.15.82:0/1891627563 learned_addr learned my addr 172.21.15.82:0/1891627563 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a54133e80 0x7f5a54141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54150/0 (socket says 172.21.15.82:54150) 2020-04-02T23:47:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a51d9b700 1 --2- 172.21.15.82:0/1891627563 >> v2:172.21.15.50:3300/0 conn(0x7f5a540a7590 0x7f5a54133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 -- 172.21.15.82:0/1891627563 >> v2:172.21.15.50:3300/0 conn(0x7f5a540a7590 msgr2=0x7f5a54133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- 172.21.15.82:0/1891627563 >> v2:172.21.15.50:3300/0 conn(0x7f5a540a7590 0x7f5a54133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 -- 172.21.15.82:0/1891627563 >> v1:172.21.15.82:6789/0 conn(0x7f5a540a8410 legacy=0x7f5a540a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a5159a700 1 -- 172.21.15.82:0/1891627563 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635141362 0 0) 0x7f5a540a73a0 con 0x7f5a540a8410 2020-04-02T23:47:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 -- 172.21.15.82:0/1891627563 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a540a6f00 con 0x7f5a54133e80 2020-04-02T23:47:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- 172.21.15.82:0/1891627563 >> v2:172.21.15.82:3300/0 conn(0x7f5a54133e80 0x7f5a54141390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a4c002f30 tx=0x7f5a4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- 172.21.15.82:0/1891627563 >> v2:172.21.15.82:3300/0 conn(0x7f5a54133e80 0x7f5a54141390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a4c002f30 tx=0x7f5a4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- 172.21.15.82:0/1891627563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a54133e80 0x7f5a54141390 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f5a4c002f30 tx=0x7f5a4c007a40).ready entity=mon.1 client_cookie=1092efc37b2aabaa server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- 172.21.15.82:0/1891627563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a54133e80 0x7f5a54141390 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f5a4c002f30 tx=0x7f5a4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a5159a700 1 -- 172.21.15.82:0/1891627563 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4c011470 con 0x7f5a54133e80 2020-04-02T23:47:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- 172.21.15.82:0/1891627563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a54133e80 0x7f5a54141390 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f5a4c002f30 tx=0x7f5a4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a5159a700 1 -- 172.21.15.82:0/1891627563 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c0115d0 con 0x7f5a54133e80 2020-04-02T23:47:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a52d9d700 1 --2- 172.21.15.82:0/1891627563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a54133e80 0x7f5a54141390 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f5a4c002f30 tx=0x7f5a4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a5159a700 1 -- 172.21.15.82:0/1891627563 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4c011970 con 0x7f5a54133e80 2020-04-02T23:47:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a58967700 1 -- 172.21.15.82:0/1891627563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a54133e80 msgr2=0x7f5a54141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.364+0000 7f5a58967700 1 --2- 172.21.15.82:0/1891627563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a54133e80 0x7f5a54141390 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f5a4c002f30 tx=0x7f5a4c007a40).stop 2020-04-02T23:47:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.365+0000 7f5a58967700 1 -- 172.21.15.82:0/1891627563 shutdown_connections 2020-04-02T23:47:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.365+0000 7f5a58967700 1 --2- 172.21.15.82:0/1891627563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a54133e80 0x7f5a54141390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.365+0000 7f5a58967700 1 --2- 172.21.15.82:0/1891627563 >> v2:172.21.15.50:3300/0 conn(0x7f5a540a7590 0x7f5a54133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.365+0000 7f5a58967700 1 -- 172.21.15.82:0/1891627563 >> 172.21.15.82:0/1891627563 conn(0x7f5a540ab970 msgr2=0x7f5a540a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.365+0000 7f5a58967700 1 -- 172.21.15.82:0/1891627563 shutdown_connections 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.365+0000 7f5a58967700 1 -- 172.21.15.82:0/1891627563 wait complete. 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a58967700 1 Processor -- start 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a58967700 1 -- start start 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a58967700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a540a8410 0x7f5a5412e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a58967700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a54133e80 0x7f5a540aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a58967700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a54132200 con 0x7f5a540aa9d0 2020-04-02T23:47:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a58967700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a541324a0 con 0x7f5a540a8410 2020-04-02T23:47:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a58967700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a54132740 con 0x7f5a54133e80 2020-04-02T23:47:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a5259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a540a8410 0x7f5a5412e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a52d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5a540aa9d0 0x7f5a5409a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54206/0 (socket says 172.21.15.82:54206) 2020-04-02T23:47:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a5259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a540a8410 0x7f5a5412e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54154/0 (socket says 172.21.15.82:54154) 2020-04-02T23:47:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a52d9d700 1 -- 172.21.15.82:0/1888799243 learned_addr learned my addr 172.21.15.82:0/1888799243 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.366+0000 7f5a51d9b700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a54133e80 0x7f5a540aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 -- 172.21.15.82:0/1888799243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a54133e80 msgr2=0x7f5a540aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a54133e80 0x7f5a540aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 -- 172.21.15.82:0/1888799243 >> v1:172.21.15.82:6789/0 conn(0x7f5a540aa9d0 legacy=0x7f5a5409a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459866665 0 0) 0x7f5a54132200 con 0x7f5a540aa9d0 2020-04-02T23:47:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 -- 172.21.15.82:0/1888799243 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a541346d0 con 0x7f5a540a8410 2020-04-02T23:47:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> v2:172.21.15.82:3300/0 conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> v2:172.21.15.82:3300/0 conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.380 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.380 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.380 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a44005e30 con 0x7f5a540a8410 2020-04-02T23:47:07.380 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.380 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44012510 con 0x7f5a540a8410 2020-04-02T23:47:07.380 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.381 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a54131e80 con 0x7f5a540a8410 2020-04-02T23:47:07.381 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a440128f0 con 0x7f5a540a8410 2020-04-02T23:47:07.381 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.367+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a540a8cf0 con 0x7f5a540a8410 2020-04-02T23:47:07.381 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.368+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.382 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.368+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5a44012b70 con 0x7f5a540a8410 2020-04-02T23:47:07.382 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.368+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.382 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.368+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a540aa260 con 0x7f5a540a8410 2020-04-02T23:47:07.382 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.368+0000 7f5a437fe700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 0x7f5a3004fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:07.382 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.369+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5a44061440 con 0x7f5a540a8410 2020-04-02T23:47:07.382 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.369+0000 7f5a51d9b700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 0x7f5a3004fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.383 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.369+0000 7f5a51d9b700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 0x7f5a3004fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a48002f30 tx=0x7f5a4800d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.383 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.369+0000 7f5a51d9b700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 0x7f5a3004fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a48002f30 tx=0x7f5a4800d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.383 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.369+0000 7f5a51d9b700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 0x7f5a3004fa40 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f5a48002f30 tx=0x7f5a4800d710).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.383 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.372+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.384 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.372+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f5a4403cb80 con 0x7f5a540a8410 2020-04-02T23:47:07.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.509+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a54056c50 con 0x7f5a540a8410 2020-04-02T23:47:07.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.509+0000 7f5a5259c700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.509+0000 7f5a437fe700 1 -- 172.21.15.82:0/1888799243 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a440401a0 con 0x7f5a540a8410 2020-04-02T23:47:07.512 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:07.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 msgr2=0x7f5a3004fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 0x7f5a3004fa40 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f5a48002f30 tx=0x7f5a4800d710).stop 2020-04-02T23:47:07.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 msgr2=0x7f5a5412e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f5a44000f00 tx=0x7f5a44010c80).stop 2020-04-02T23:47:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 shutdown_connections 2020-04-02T23:47:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5a3004d580 0x7f5a3004fa40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a540a8410 0x7f5a5412e200 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 --2- 172.21.15.82:0/1888799243 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a54133e80 0x7f5a540aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 >> 172.21.15.82:0/1888799243 conn(0x7f5a540ab970 msgr2=0x7f5a54068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 shutdown_connections 2020-04-02T23:47:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.511+0000 7f5a58967700 1 -- 172.21.15.82:0/1888799243 wait complete. 2020-04-02T23:47:07.523 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:07.536 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:47:07.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.682+0000 7fe669aa0700 1 Processor -- start 2020-04-02T23:47:07.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.682+0000 7fe669aa0700 1 -- start start 2020-04-02T23:47:07.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe669aa0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6640a7590 0x7fe664133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe669aa0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe664133e80 0x7fe664141390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:07.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe669aa0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6640a73a0 con 0x7fe6640a8410 2020-04-02T23:47:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe669aa0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6640a45a0 con 0x7fe6640a7590 2020-04-02T23:47:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe669aa0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6640a6c60 con 0x7fe664133e80 2020-04-02T23:47:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe664133e80 0x7fe664141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe6637fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe6640a8410 0x7fe6640a4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54216/0 (socket says 172.21.15.82:54216) 2020-04-02T23:47:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe6637fe700 1 -- 172.21.15.82:0/3336429096 learned_addr learned my addr 172.21.15.82:0/3336429096 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe662ffd700 1 --2- 172.21.15.82:0/3336429096 >> v2:172.21.15.50:3300/0 conn(0x7fe6640a7590 0x7fe664133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 -- 172.21.15.82:0/3336429096 >> v2:172.21.15.50:3300/0 conn(0x7fe6640a7590 msgr2=0x7fe664133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 --2- 172.21.15.82:0/3336429096 >> v2:172.21.15.50:3300/0 conn(0x7fe6640a7590 0x7fe664133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 -- 172.21.15.82:0/3336429096 >> v1:172.21.15.82:6789/0 conn(0x7fe6640a8410 legacy=0x7fe6640a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 -- 172.21.15.82:0/3336429096 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6640a6f00 con 0x7fe664133e80 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 --2- 172.21.15.82:0/3336429096 >> v2:172.21.15.82:3300/0 conn(0x7fe664133e80 0x7fe664141390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe65c0032b0 tx=0x7fe65c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 --2- 172.21.15.82:0/3336429096 >> v2:172.21.15.82:3300/0 conn(0x7fe664133e80 0x7fe664141390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe65c0032b0 tx=0x7fe65c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.683+0000 7fe663fff700 1 --2- 172.21.15.82:0/3336429096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664133e80 0x7fe664141390 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fe65c0032b0 tx=0x7fe65c007dc0).ready entity=mon.1 client_cookie=298f34334b1bddab server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe663fff700 1 --2- 172.21.15.82:0/3336429096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664133e80 0x7fe664141390 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe65c0032b0 tx=0x7fe65c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe6627fc700 1 -- 172.21.15.82:0/3336429096 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65c00a160 con 0x7fe664133e80 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe663fff700 1 --2- 172.21.15.82:0/3336429096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664133e80 0x7fe664141390 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe65c0032b0 tx=0x7fe65c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe663fff700 1 --2- 172.21.15.82:0/3336429096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664133e80 0x7fe664141390 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe65c0032b0 tx=0x7fe65c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe6627fc700 1 -- 172.21.15.82:0/3336429096 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00a2c0 con 0x7fe664133e80 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe6627fc700 1 -- 172.21.15.82:0/3336429096 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65c00a660 con 0x7fe664133e80 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 -- 172.21.15.82:0/3336429096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664133e80 msgr2=0x7fe664141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 --2- 172.21.15.82:0/3336429096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664133e80 0x7fe664141390 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fe65c0032b0 tx=0x7fe65c007dc0).stop 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 -- 172.21.15.82:0/3336429096 shutdown_connections 2020-04-02T23:47:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 --2- 172.21.15.82:0/3336429096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664133e80 0x7fe664141390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 --2- 172.21.15.82:0/3336429096 >> v2:172.21.15.50:3300/0 conn(0x7fe6640a7590 0x7fe664133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 -- 172.21.15.82:0/3336429096 >> 172.21.15.82:0/3336429096 conn(0x7fe6640ab970 msgr2=0x7fe6640a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 -- 172.21.15.82:0/3336429096 shutdown_connections 2020-04-02T23:47:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.684+0000 7fe669aa0700 1 -- 172.21.15.82:0/3336429096 wait complete. 2020-04-02T23:47:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.685+0000 7fe669aa0700 1 Processor -- start 2020-04-02T23:47:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.685+0000 7fe669aa0700 1 -- start start 2020-04-02T23:47:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe669aa0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe669aa0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe664068a70 con 0x7fe664133e80 2020-04-02T23:47:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe669aa0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe664144d60 con 0x7fe66413a3e0 2020-04-02T23:47:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe669aa0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66413a890 con 0x7fe6640a8410 2020-04-02T23:47:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe663fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe66413a3e0 0x7fe66414eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54222/0 (socket says 172.21.15.82:54222) 2020-04-02T23:47:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe663fff700 1 -- 172.21.15.82:0/1615562481 learned_addr learned my addr 172.21.15.82:0/1615562481 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081890512 0 0) 0x7fe664144d60 con 0x7fe66413a3e0 2020-04-02T23:47:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe644002fe0 con 0x7fe66413a3e0 2020-04-02T23:47:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645676839 0 0) 0x7fe664068a70 con 0x7fe664133e80 2020-04-02T23:47:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe664144d60 con 0x7fe664133e80 2020-04-02T23:47:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1197821625 0 0) 0x7fe644002fe0 con 0x7fe66413a3e0 2020-04-02T23:47:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe664068a70 con 0x7fe66413a3e0 2020-04-02T23:47:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fe65c008940 con 0x7fe66413a3e0 2020-04-02T23:47:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe6637fe700 1 -- 172.21.15.82:0/1615562481 >> v1:172.21.15.82:6789/0 conn(0x7fe66413a3e0 legacy=0x7fe66414eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe6637fe700 1 -- 172.21.15.82:0/1615562481 >> v1:172.21.15.50:6789/0 conn(0x7fe664133e80 legacy=0x7fe664137bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe6637fe700 1 -- 172.21.15.82:0/1615562481 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664145000 con 0x7fe6640a8410 2020-04-02T23:47:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.686+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe654005a90 con 0x7fe6640a8410 2020-04-02T23:47:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654005bf0 con 0x7fe6640a8410 2020-04-02T23:47:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6641346d0 con 0x7fe6640a8410 2020-04-02T23:47:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6540060c0 con 0x7fe6640a8410 2020-04-02T23:47:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66413ac10 con 0x7fe6640a8410 2020-04-02T23:47:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.687+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe664144ba0 con 0x7fe6640a8410 2020-04-02T23:47:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe65400a320 con 0x7fe6640a8410 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe660ff9700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 0x7fe644050140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe654060bf0 con 0x7fe6640a8410 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe662ffd700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 0x7fe644050140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe662ffd700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 0x7fe644050140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe658002ef0 tx=0x7fe658008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe662ffd700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 0x7fe644050140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe658002ef0 tx=0x7fe658008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.688+0000 7fe662ffd700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 0x7fe644050140 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe658002ef0 tx=0x7fe658008e30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.692+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.692+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe65403c1d0 con 0x7fe6640a8410 2020-04-02T23:47:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.830+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe664056c50 con 0x7fe6640a8410 2020-04-02T23:47:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.830+0000 7fe6637fe700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.830+0000 7fe660ff9700 1 -- 172.21.15.82:0/1615562481 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe65403f7f0 con 0x7fe6640a8410 2020-04-02T23:47:07.833 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 msgr2=0x7fe644050140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 0x7fe644050140 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe658002ef0 tx=0x7fe658008e30).stop 2020-04-02T23:47:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 msgr2=0x7fe6640aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fe6640aae30 tx=0x7fe654010840).stop 2020-04-02T23:47:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 shutdown_connections 2020-04-02T23:47:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe64404dc80 0x7fe644050140 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 --2- 172.21.15.82:0/1615562481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6640a8410 0x7fe6640aa2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 >> 172.21.15.82:0/1615562481 conn(0x7fe6640ab970 msgr2=0x7fe66405b010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 shutdown_connections 2020-04-02T23:47:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:07.832+0000 7fe669aa0700 1 -- 172.21.15.82:0/1615562481 wait complete. 2020-04-02T23:47:07.844 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:07.857 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:47:08.004 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.002+0000 7fca8e38c700 1 Processor -- start 2020-04-02T23:47:08.004 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.002+0000 7fca8e38c700 1 -- start start 2020-04-02T23:47:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca8e38c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca880a3b10 0x7fca88135ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca8e38c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880a6e40 con 0x7fca8809f6d0 2020-04-02T23:47:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca8e38c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880a38c0 con 0x7fca880a8410 2020-04-02T23:47:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca8e38c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca88067330 con 0x7fca880a3b10 2020-04-02T23:47:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca87fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fca880a8410 0x7fca881361f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54226/0 (socket says 172.21.15.82:54226) 2020-04-02T23:47:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca87fff700 1 -- 172.21.15.82:0/1855177606 learned_addr learned my addr 172.21.15.82:0/1855177606 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca8c929700 1 --2- 172.21.15.82:0/1855177606 >> v2:172.21.15.50:3300/0 conn(0x7fca880a3b10 0x7fca88135ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454061630 0 0) 0x7fca880a38c0 con 0x7fca880a8410 2020-04-02T23:47:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca74003230 con 0x7fca880a8410 2020-04-02T23:47:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2117879598 0 0) 0x7fca74003230 con 0x7fca880a8410 2020-04-02T23:47:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 >> v2:172.21.15.50:3300/0 conn(0x7fca880a3b10 msgr2=0x7fca88135ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 --2- 172.21.15.82:0/1855177606 >> v2:172.21.15.50:3300/0 conn(0x7fca880a3b10 0x7fca88135ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 >> v1:172.21.15.50:6789/0 conn(0x7fca8809f6d0 legacy=0x7fca8813e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880a4090 con 0x7fca880a8410 2020-04-02T23:47:08.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fca780016d0 con 0x7fca880a8410 2020-04-02T23:47:08.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 >> v1:172.21.15.82:6789/0 conn(0x7fca880a8410 legacy=0x7fca881361f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca740044d0 0x7fca74004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca74004db0 0x7fca7400d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88067330 con 0x7fca74004db0 2020-04-02T23:47:08.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740041c0 con 0x7fca74003720 2020-04-02T23:47:08.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7400dd90 con 0x7fca740044d0 2020-04-02T23:47:08.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.003+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8c929700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca74004db0 0x7fca7400d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca877fe700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca740044d0 0x7fca74004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 -- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca740044d0 msgr2=0x7fca74004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca740044d0 0x7fca74004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 -- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca74004db0 msgr2=0x7fca7400d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca74004db0 0x7fca7400d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 -- 172.21.15.82:0/1855177606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74003230 con 0x7fca74003720 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8c929700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca74004db0 0x7fca7400d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8c929700 1 -- 172.21.15.82:0/1855177606 reap_dead start 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).ready entity=mon.1 client_cookie=75f5afbb51f37ff1 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7800e160 con 0x7fca74003720 2020-04-02T23:47:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800e2c0 con 0x7fca74003720 2020-04-02T23:47:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca87fff700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca86ffd700 1 -- 172.21.15.82:0/1855177606 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7800e6a0 con 0x7fca74003720 2020-04-02T23:47:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8e38c700 1 -- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 msgr2=0x7fca74003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8e38c700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).stop 2020-04-02T23:47:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8e38c700 1 -- 172.21.15.82:0/1855177606 shutdown_connections 2020-04-02T23:47:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8e38c700 1 --2- 172.21.15.82:0/1855177606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74003720 0x7fca74003b40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8e38c700 1 -- 172.21.15.82:0/1855177606 >> 172.21.15.82:0/1855177606 conn(0x7fca880ab970 msgr2=0x7fca880a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8e38c700 1 -- 172.21.15.82:0/1855177606 shutdown_connections 2020-04-02T23:47:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.004+0000 7fca8e38c700 1 -- 172.21.15.82:0/1855177606 wait complete. 2020-04-02T23:47:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.005+0000 7fca8e38c700 1 Processor -- start 2020-04-02T23:47:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.005+0000 7fca8e38c700 1 -- start start 2020-04-02T23:47:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca8e38c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca74003720 0x7fca88060aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca8e38c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca88061680 con 0x7fca88142c40 2020-04-02T23:47:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca8e38c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca88133880 con 0x7fca88063ab0 2020-04-02T23:47:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca8e38c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca88062e20 con 0x7fca74003720 2020-04-02T23:47:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca877fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fca88063ab0 0x7fca88142530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54240/0 (socket says 172.21.15.82:54240) 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca877fe700 1 -- 172.21.15.82:0/283824103 learned_addr learned my addr 172.21.15.82:0/283824103 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca74003720 0x7fca88060aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932714445 0 0) 0x7fca880a6e40 con 0x7fca88063ab0 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca68002fe0 con 0x7fca88063ab0 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974701122 0 0) 0x7fca88061680 con 0x7fca88142c40 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca880a6e40 con 0x7fca88142c40 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 235979752 0 0) 0x7fca68002fe0 con 0x7fca88063ab0 2020-04-02T23:47:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca88061680 con 0x7fca88063ab0 2020-04-02T23:47:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.006+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fca7c001b30 con 0x7fca88063ab0 2020-04-02T23:47:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca74003720 msgr2=0x7fca88060aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca74003720 0x7fca88060aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 >> v1:172.21.15.82:6789/0 conn(0x7fca88063ab0 legacy=0x7fca88142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 >> v1:172.21.15.50:6789/0 conn(0x7fca88142c40 legacy=0x7fca8814ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca68003ab0 0x7fca68003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca68004390 0x7fca6800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88062e20 con 0x7fca68004390 2020-04-02T23:47:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca68004810 con 0x7fca68004b20 2020-04-02T23:47:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6800bbb0 con 0x7fca68003ab0 2020-04-02T23:47:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca74003720 0x7fca88060aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca8c929700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca68004390 0x7fca6800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca877fe700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca68003ab0 0x7fca68003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 -- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca68003ab0 msgr2=0x7fca68003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fca68003ab0 0x7fca68003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 -- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca68004390 msgr2=0x7fca6800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca68004390 0x7fca6800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68002fe0 con 0x7fca68004b20 2020-04-02T23:47:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca880618b0 con 0x7fca68004b20 2020-04-02T23:47:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca880622d0 con 0x7fca68004b20 2020-04-02T23:47:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca78001b40 con 0x7fca68004b20 2020-04-02T23:47:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800eb30 con 0x7fca68004b20 2020-04-02T23:47:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.007+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca780100b0 con 0x7fca68004b20 2020-04-02T23:47:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.008+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.008+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca64003340 con 0x7fca68004b20 2020-04-02T23:47:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.008+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fca78010210 con 0x7fca68004b20 2020-04-02T23:47:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.008+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.009+0000 7fca857fa700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fca68055c50 0x7fca68058110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.009+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fca78060ee0 con 0x7fca68004b20 2020-04-02T23:47:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.009+0000 7fca877fe700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fca68055c50 0x7fca68058110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.009+0000 7fca877fe700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fca68055c50 0x7fca68058110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca7c001240 tx=0x7fca7c007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.009+0000 7fca877fe700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fca68055c50 0x7fca68058110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca7c001240 tx=0x7fca7c007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.009+0000 7fca877fe700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fca68055c50 0x7fca68058110 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fca7c001240 tx=0x7fca7c007c30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.012+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.012+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fca7803c700 con 0x7fca68004b20 2020-04-02T23:47:08.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.148+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca64002200 con 0x7fca68004b20 2020-04-02T23:47:08.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.149+0000 7fca87fff700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.149+0000 7fca857fa700 1 -- 172.21.15.82:0/283824103 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7fca7803fd20 con 0x7fca68004b20 2020-04-02T23:47:08.151 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:08.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fca68055c50 msgr2=0x7fca68058110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fca68055c50 0x7fca68058110 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fca7c001240 tx=0x7fca7c007c30).stop 2020-04-02T23:47:08.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 msgr2=0x7fca68004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 --2- 172.21.15.82:0/283824103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca68004b20 0x7fca68004f00 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fca740054a0 tx=0x7fca880a87f0).stop 2020-04-02T23:47:08.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8c929700 1 -- 172.21.15.82:0/283824103 reap_dead start 2020-04-02T23:47:08.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8c929700 1 -- 172.21.15.82:0/283824103 reap_dead start 2020-04-02T23:47:08.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 shutdown_connections 2020-04-02T23:47:08.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 >> 172.21.15.82:0/283824103 conn(0x7fca880ab970 msgr2=0x7fca880a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:08.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 shutdown_connections 2020-04-02T23:47:08.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.150+0000 7fca8e38c700 1 -- 172.21.15.82:0/283824103 wait complete. 2020-04-02T23:47:08.162 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-02T23:47:08.162 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-02T23:47:08.162 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:08.175 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-02T23:47:08.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff83ae71700 1 Processor -- start 2020-04-02T23:47:08.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff83ae71700 1 -- start start 2020-04-02T23:47:08.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff83ae71700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff8340aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff83ae71700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8340a4b70 0x7ff8340a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff83ae71700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8340a5820 con 0x7ff834136160 2020-04-02T23:47:08.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff83ae71700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340a4130 con 0x7ff8340a2ab0 2020-04-02T23:47:08.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff83ae71700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340a43d0 con 0x7ff8340a4b70 2020-04-02T23:47:08.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.319+0000 7ff833fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8340a4b70 0x7ff8340a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff83940e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff834136160 0x7ff8341365d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54252/0 (socket says 172.21.15.82:54252) 2020-04-02T23:47:08.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff83940e700 1 -- 172.21.15.82:0/4005623494 learned_addr learned my addr 172.21.15.82:0/4005623494 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:08.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff838c0d700 1 --2- 172.21.15.82:0/4005623494 >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff8340aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 -- 172.21.15.82:0/4005623494 >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 msgr2=0x7ff8340aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:08.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 --2- 172.21.15.82:0/4005623494 >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff8340aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 -- 172.21.15.82:0/4005623494 >> v1:172.21.15.82:6789/0 conn(0x7ff834136160 legacy=0x7ff8341365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff8337fe700 1 -- 172.21.15.82:0/4005623494 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661504014 0 0) 0x7ff8340a5820 con 0x7ff834136160 2020-04-02T23:47:08.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 -- 172.21.15.82:0/4005623494 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340a4670 con 0x7ff8340a4b70 2020-04-02T23:47:08.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 --2- 172.21.15.82:0/4005623494 >> v2:172.21.15.82:3300/0 conn(0x7ff8340a4b70 0x7ff8340a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff828002f30 tx=0x7ff828007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 --2- 172.21.15.82:0/4005623494 >> v2:172.21.15.82:3300/0 conn(0x7ff8340a4b70 0x7ff8340a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff828002f30 tx=0x7ff828007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 --2- 172.21.15.82:0/4005623494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8340a4b70 0x7ff8340a4ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7ff828002f30 tx=0x7ff828007a40).ready entity=mon.1 client_cookie=429426ef8ec11a9f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 --2- 172.21.15.82:0/4005623494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8340a4b70 0x7ff8340a4ff0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7ff828002f30 tx=0x7ff828007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff8337fe700 1 -- 172.21.15.82:0/4005623494 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8280113c0 con 0x7ff8340a4b70 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 --2- 172.21.15.82:0/4005623494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8340a4b70 0x7ff8340a4ff0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7ff828002f30 tx=0x7ff828007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff833fff700 1 --2- 172.21.15.82:0/4005623494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8340a4b70 0x7ff8340a4ff0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7ff828002f30 tx=0x7ff828007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff8337fe700 1 -- 172.21.15.82:0/4005623494 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828011520 con 0x7ff8340a4b70 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff8337fe700 1 -- 172.21.15.82:0/4005623494 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8280118c0 con 0x7ff8340a4b70 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff83ae71700 1 -- 172.21.15.82:0/4005623494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8340a4b70 msgr2=0x7ff8340a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff83ae71700 1 --2- 172.21.15.82:0/4005623494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8340a4b70 0x7ff8340a4ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7ff828002f30 tx=0x7ff828007a40).stop 2020-04-02T23:47:08.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff83ae71700 1 -- 172.21.15.82:0/4005623494 shutdown_connections 2020-04-02T23:47:08.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff83ae71700 1 --2- 172.21.15.82:0/4005623494 >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff8340aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.320+0000 7ff83ae71700 1 --2- 172.21.15.82:0/4005623494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8340a4b70 0x7ff8340a4ff0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.321+0000 7ff83ae71700 1 -- 172.21.15.82:0/4005623494 >> 172.21.15.82:0/4005623494 conn(0x7ff83409de60 msgr2=0x7ff83409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:08.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.321+0000 7ff83ae71700 1 -- 172.21.15.82:0/4005623494 shutdown_connections 2020-04-02T23:47:08.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.321+0000 7ff83ae71700 1 -- 172.21.15.82:0/4005623494 wait complete. 2020-04-02T23:47:08.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.321+0000 7ff83ae71700 1 Processor -- start 2020-04-02T23:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.321+0000 7ff83ae71700 1 -- start start 2020-04-02T23:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff83ae71700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff83409f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff83ae71700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff834136160 0x7ff834138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff83ae71700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff834137e20 con 0x7ff8340a4b70 2020-04-02T23:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff83ae71700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83409f640 con 0x7ff8340a2ab0 2020-04-02T23:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff83ae71700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834138bf0 con 0x7ff834136160 2020-04-02T23:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff833fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff8340a4b70 0x7ff834137450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54260/0 (socket says 172.21.15.82:54260) 2020-04-02T23:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff833fff700 1 -- 172.21.15.82:0/3240657577 learned_addr learned my addr 172.21.15.82:0/3240657577 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff83940e700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff834136160 0x7ff834138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff83409f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836252571 0 0) 0x7ff834137e20 con 0x7ff8340a4b70 2020-04-02T23:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.322+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff814002fe0 con 0x7ff8340a4b70 2020-04-02T23:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3782337809 0 0) 0x7ff814002fe0 con 0x7ff8340a4b70 2020-04-02T23:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 -- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff834136160 msgr2=0x7ff834138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.335 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff834136160 0x7ff834138790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.335 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 -- 172.21.15.82:0/3240657577 >> v1:172.21.15.82:6789/0 conn(0x7ff8340a4b70 legacy=0x7ff834137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.335 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 -- 172.21.15.82:0/3240657577 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834066e10 con 0x7ff8340a2ab0 2020-04-02T23:47:08.335 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.335 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> v2:172.21.15.50:3300/0 conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.335 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.335 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff828008e10 con 0x7ff8340a2ab0 2020-04-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff834138050 con 0x7ff8340a2ab0 2020-04-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824007340 con 0x7ff8340a2ab0 2020-04-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8240056c0 con 0x7ff8340a2ab0 2020-04-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.323+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff834143580 con 0x7ff8340a2ab0 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.324+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.324+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8341384b0 con 0x7ff8340a2ab0 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.324+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff8240058b0 con 0x7ff8340a2ab0 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.324+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.324+0000 7ff831ffb700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 0x7ff81404fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.324+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff82400d0c0 con 0x7ff8340a2ab0 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.325+0000 7ff833fff700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 0x7ff81404fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.325+0000 7ff833fff700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 0x7ff81404fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8280112e0 tx=0x7ff828007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.325+0000 7ff833fff700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 0x7ff81404fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8280112e0 tx=0x7ff828007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.325+0000 7ff833fff700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 0x7ff81404fcf0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7ff8280112e0 tx=0x7ff828007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.328+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.328+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff82403c0b0 con 0x7ff8340a2ab0 2020-04-02T23:47:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.502+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff834056c50 con 0x7ff8340a2ab0 2020-04-02T23:47:08.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.506+0000 7ff838c0d700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.506+0000 7ff831ffb700 1 -- 172.21.15.82:0/3240657577 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+119887 (secure 0 0 0) 0x7ff82403f6d0 con 0x7ff8340a2ab0 2020-04-02T23:47:08.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.506+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 msgr2=0x7ff81404fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.506+0000 7ff83ae71700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 0x7ff81404fcf0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7ff8280112e0 tx=0x7ff828007a40).stop 2020-04-02T23:47:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.506+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 msgr2=0x7ff83409f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.506+0000 7ff83ae71700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7ff828008f70 tx=0x7ff824010b90).stop 2020-04-02T23:47:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.507+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 shutdown_connections 2020-04-02T23:47:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.507+0000 7ff83ae71700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff834136160 0x7ff834138790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.507+0000 7ff83ae71700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8340a2ab0 0x7ff83409f1e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.507+0000 7ff83ae71700 1 --2- 172.21.15.82:0/3240657577 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff81404d830 0x7ff81404fcf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.507+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 >> 172.21.15.82:0/3240657577 conn(0x7ff83409de60 msgr2=0x7ff83409e240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.507+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 shutdown_connections 2020-04-02T23:47:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.507+0000 7ff83ae71700 1 -- 172.21.15.82:0/3240657577 wait complete. 2020-04-02T23:47:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:08.519 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":4,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":23559},{"type":"v1","addr":"172.21.15.82:6801","nonce":23559}]},"active_addr":"172.21.15.82:6801/23559","active_change":"2020-04-02T23:46:42.406181+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":363634940}]},{"addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2569234059}]},{"addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3717942218}]}]}} 2020-04-02T23:47:08.527 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-02T23:47:08.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-02T23:47:08.527 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:08.541 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:08.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.684+0000 7f1199ecc700 1 Processor -- start 2020-04-02T23:47:08.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.684+0000 7f1199ecc700 1 -- start start 2020-04-02T23:47:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.684+0000 7f1199ecc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11940a4b70 0x7f11940a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.684+0000 7f1199ecc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940a5820 con 0x7f1194136160 2020-04-02T23:47:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.684+0000 7f1199ecc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940a4130 con 0x7f11940a2ab0 2020-04-02T23:47:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.684+0000 7f1199ecc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11940a43d0 con 0x7f11940a4b70 2020-04-02T23:47:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11937fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f11940a2ab0 0x7f11940aae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54266/0 (socket says 172.21.15.82:54266) 2020-04-02T23:47:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11937fe700 1 -- 172.21.15.82:0/666469800 learned_addr learned my addr 172.21.15.82:0/666469800 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1192ffd700 1 --2- 172.21.15.82:0/666469800 >> v2:172.21.15.50:3300/0 conn(0x7f11940a4b70 0x7f11940a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361411417 0 0) 0x7f11940a4130 con 0x7f11940a2ab0 2020-04-02T23:47:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1174003230 con 0x7f11940a2ab0 2020-04-02T23:47:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3559993303 0 0) 0x7f1174003230 con 0x7f11940a2ab0 2020-04-02T23:47:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 >> v2:172.21.15.50:3300/0 conn(0x7f11940a4b70 msgr2=0x7f11940a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 --2- 172.21.15.82:0/666469800 >> v2:172.21.15.50:3300/0 conn(0x7f11940a4b70 0x7f11940a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 >> v1:172.21.15.50:6789/0 conn(0x7f1194136160 legacy=0x7f11941365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940a4670 con 0x7f11940a2ab0 2020-04-02T23:47:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f11840016d0 con 0x7f11940a2ab0 2020-04-02T23:47:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 >> v1:172.21.15.82:6789/0 conn(0x7f11940a2ab0 legacy=0x7f11940aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1174003720 0x7f1174003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11740044d0 0x7f1174004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940a43d0 con 0x7f1174003720 2020-04-02T23:47:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740041c0 con 0x7f1174004db0 2020-04-02T23:47:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117400bb80 con 0x7f11740044d0 2020-04-02T23:47:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f11937fe700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1174003720 0x7f1174003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1192ffd700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11740044d0 0x7f1174004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1193fff700 1 -- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11740044d0 msgr2=0x7f1174004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f11740044d0 0x7f1174004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1193fff700 1 -- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1174003720 msgr2=0x7f1174003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1174003720 0x7f1174003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:08.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.685+0000 7f1193fff700 1 -- 172.21.15.82:0/666469800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1174003230 con 0x7f1174004db0 2020-04-02T23:47:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11740054a0 tx=0x7f118c0122a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1193fff700 1 -- 172.21.15.82:0/666469800 reap_dead start 2020-04-02T23:47:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11740054a0 tx=0x7f118c0122a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f11740054a0 tx=0x7f118c0122a0).ready entity=mon.1 client_cookie=65c499ae057a26ee server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f11740054a0 tx=0x7f118c0122a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f11740054a0 tx=0x7f118c0122a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1193fff700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f11740054a0 tx=0x7f118c0122a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118c006c40 con 0x7f1174004db0 2020-04-02T23:47:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c006da0 con 0x7f1174004db0 2020-04-02T23:47:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f11927fc700 1 -- 172.21.15.82:0/666469800 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118c002750 con 0x7f1174004db0 2020-04-02T23:47:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1199ecc700 1 -- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 msgr2=0x7f117400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1199ecc700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f11740054a0 tx=0x7f118c0122a0).stop 2020-04-02T23:47:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1199ecc700 1 -- 172.21.15.82:0/666469800 shutdown_connections 2020-04-02T23:47:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1199ecc700 1 --2- 172.21.15.82:0/666469800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1174004db0 0x7f117400b720 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1199ecc700 1 -- 172.21.15.82:0/666469800 >> 172.21.15.82:0/666469800 conn(0x7f119409de60 msgr2=0x7f119409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1199ecc700 1 -- 172.21.15.82:0/666469800 shutdown_connections 2020-04-02T23:47:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.686+0000 7f1199ecc700 1 -- 172.21.15.82:0/666469800 wait complete. 2020-04-02T23:47:08.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.687+0000 7f1199ecc700 1 Processor -- start 2020-04-02T23:47:08.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.687+0000 7f1199ecc700 1 -- start start 2020-04-02T23:47:08.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1199ecc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1174004db0 0x7f1194132490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1199ecc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1194136d80 0x7f11940a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1199ecc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940673b0 con 0x7f11941328f0 2020-04-02T23:47:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1199ecc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11940a5680 con 0x7f1194136d80 2020-04-02T23:47:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1199ecc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11940aaad0 con 0x7f1174004db0 2020-04-02T23:47:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1194136d80 0x7f11940a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1194136d80 0x7f11940a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54228/0 (socket says 172.21.15.82:54228) 2020-04-02T23:47:08.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 -- 172.21.15.82:0/3067954039 learned_addr learned my addr 172.21.15.82:0/3067954039 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:08.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f11937fe700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1174004db0 0x7f1194132490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 -- 172.21.15.82:0/3067954039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1174004db0 msgr2=0x7f1194132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1174004db0 0x7f1194132490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 -- 172.21.15.82:0/3067954039 >> v1:172.21.15.50:6789/0 conn(0x7f11941328f0 legacy=0x7f11940aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 -- 172.21.15.82:0/3067954039 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119412dec0 con 0x7f1194136d80 2020-04-02T23:47:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> v2:172.21.15.82:3300/0 conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> v2:172.21.15.82:3300/0 conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.688+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1190ff9700 1 -- 172.21.15.82:0/3067954039 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117c005aa0 con 0x7f1194136d80 2020-04-02T23:47:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1190ff9700 1 -- 172.21.15.82:0/3067954039 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c005c40 con 0x7f1194136d80 2020-04-02T23:47:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1190ff9700 1 -- 172.21.15.82:0/3067954039 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117c005e70 con 0x7f1194136d80 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1194137280 con 0x7f1194136d80 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11940668b0 con 0x7f1194136d80 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.689+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11941321b0 con 0x7f1194136d80 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f1190ff9700 1 -- 172.21.15.82:0/3067954039 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f117c007140 con 0x7f1194136d80 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f1190ff9700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 0x7f117804f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f1190ff9700 1 -- 172.21.15.82:0/3067954039 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f117c060a50 con 0x7f1194136d80 2020-04-02T23:47:08.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f11937fe700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 0x7f117804f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:08.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f11937fe700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 0x7f117804f9a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11840013e0 tx=0x7f11940a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f11937fe700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 0x7f117804f9a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11840013e0 tx=0x7f11940a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.690+0000 7f11937fe700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 0x7f117804f9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f11840013e0 tx=0x7f11940a2e90).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:08.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.693+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.693+0000 7f1190ff9700 1 -- 172.21.15.82:0/3067954039 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f117c03c1b0 con 0x7f1194136d80 2020-04-02T23:47:08.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.832+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1194056c50 con 0x7f1194136d80 2020-04-02T23:47:08.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.833+0000 7f1192ffd700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:08.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.833+0000 7f1190ff9700 1 -- 172.21.15.82:0/3067954039 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f117c03f7d0 con 0x7f1194136d80 2020-04-02T23:47:08.835 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:08.835 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:08.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 msgr2=0x7f117804f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 0x7f117804f9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f11840013e0 tx=0x7f11940a2e90).stop 2020-04-02T23:47:08.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 msgr2=0x7f11940a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:08.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f117c002f30 tx=0x7f117c007fe0).stop 2020-04-02T23:47:08.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 shutdown_connections 2020-04-02T23:47:08.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f117804d4e0 0x7f117804f9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1174004db0 0x7f1194132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 --2- 172.21.15.82:0/3067954039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194136d80 0x7f11940a9f60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:08.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 >> 172.21.15.82:0/3067954039 conn(0x7f119409de60 msgr2=0x7f1194136570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:08.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 shutdown_connections 2020-04-02T23:47:08.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:08.834+0000 7f1199ecc700 1 -- 172.21.15.82:0/3067954039 wait complete. 2020-04-02T23:47:08.847 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-02T23:47:08.847 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:08.860 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.003+0000 7f865e0c6700 1 Processor -- start 2020-04-02T23:47:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.003+0000 7f865e0c6700 1 -- start start 2020-04-02T23:47:09.012 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f865e0c6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86580ab200 0x7f8658136e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.012 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f865e0c6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8658136480 0x7f86581368f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f865e0c6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86580a4be0 con 0x7f86580a4570 2020-04-02T23:47:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f865e0c6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86580a4180 con 0x7f86580ab200 2020-04-02T23:47:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f865e0c6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86580a4a00 con 0x7f8658136480 2020-04-02T23:47:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86580ab200 0x7f8658136e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f8656ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f86580a4570 0x7f8658135d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54284/0 (socket says 172.21.15.82:54284) 2020-04-02T23:47:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f8656ffd700 1 -- 172.21.15.82:0/1044453565 learned_addr learned my addr 172.21.15.82:0/1044453565 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f8657fff700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8658136480 0x7f86581368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.014 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 -- 172.21.15.82:0/1044453565 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8658136480 msgr2=0x7f86581368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8658136480 0x7f86581368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 -- 172.21.15.82:0/1044453565 >> v1:172.21.15.82:6789/0 conn(0x7f86580a4570 legacy=0x7f8658135d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86567fc700 1 -- 172.21.15.82:0/1044453565 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203472507 0 0) 0x7f86580a4be0 con 0x7f86580a4570 2020-04-02T23:47:09.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 -- 172.21.15.82:0/1044453565 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580a3d50 con 0x7f86580ab200 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- 172.21.15.82:0/1044453565 >> v2:172.21.15.82:3300/0 conn(0x7f86580ab200 0x7f8658136e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8648002f30 tx=0x7f8648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- 172.21.15.82:0/1044453565 >> v2:172.21.15.82:3300/0 conn(0x7f86580ab200 0x7f8658136e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8648002f30 tx=0x7f8648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86580ab200 0x7f8658136e50 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).ready entity=mon.1 client_cookie=bd7774bce547452b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86580ab200 0x7f8658136e50 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86567fc700 1 -- 172.21.15.82:0/1044453565 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8648011470 con 0x7f86580ab200 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86580ab200 0x7f8658136e50 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86577fe700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86580ab200 0x7f8658136e50 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86567fc700 1 -- 172.21.15.82:0/1044453565 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86480115d0 con 0x7f86580ab200 2020-04-02T23:47:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f86567fc700 1 -- 172.21.15.82:0/1044453565 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86480119b0 con 0x7f86580ab200 2020-04-02T23:47:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f865e0c6700 1 -- 172.21.15.82:0/1044453565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86580ab200 msgr2=0x7f8658136e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.004+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86580ab200 0x7f8658136e50 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).stop 2020-04-02T23:47:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.005+0000 7f865e0c6700 1 -- 172.21.15.82:0/1044453565 shutdown_connections 2020-04-02T23:47:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.005+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8658136480 0x7f86581368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.005+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1044453565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86580ab200 0x7f8658136e50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.005+0000 7f865e0c6700 1 -- 172.21.15.82:0/1044453565 >> 172.21.15.82:0/1044453565 conn(0x7f865809de60 msgr2=0x7f865809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.005+0000 7f865e0c6700 1 -- 172.21.15.82:0/1044453565 shutdown_connections 2020-04-02T23:47:09.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.005+0000 7f865e0c6700 1 -- 172.21.15.82:0/1044453565 wait complete. 2020-04-02T23:47:09.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.006+0000 7f865e0c6700 1 Processor -- start 2020-04-02T23:47:09.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.006+0000 7f865e0c6700 1 -- start start 2020-04-02T23:47:09.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f865e0c6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86580a4570 0x7f8658138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f865e0c6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8658136480 0x7f8658139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f865e0c6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865813cc80 con 0x7f86580ab200 2020-04-02T23:47:09.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f865e0c6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865813cf20 con 0x7f86580a4570 2020-04-02T23:47:09.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f865e0c6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865813d3c0 con 0x7f8658136480 2020-04-02T23:47:09.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8658136480 0x7f8658139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.020 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8656ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f86580ab200 0x7f8658135610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54290/0 (socket says 172.21.15.82:54290) 2020-04-02T23:47:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8656ffd700 1 -- 172.21.15.82:0/1978050567 learned_addr learned my addr 172.21.15.82:0/1978050567 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f86577fe700 1 --2- 172.21.15.82:0/1978050567 >> v2:172.21.15.50:3300/0 conn(0x7f86580a4570 0x7f8658138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 -- 172.21.15.82:0/1978050567 >> v2:172.21.15.50:3300/0 conn(0x7f86580a4570 msgr2=0x7f8658138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> v2:172.21.15.50:3300/0 conn(0x7f86580a4570 0x7f8658138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.022 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 -- 172.21.15.82:0/1978050567 >> v1:172.21.15.82:6789/0 conn(0x7f86580ab200 legacy=0x7f8658135610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371483842 0 0) 0x7f865813cc80 con 0x7f86580ab200 2020-04-02T23:47:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 -- 172.21.15.82:0/1978050567 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580a4b40 con 0x7f8658136480 2020-04-02T23:47:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> v2:172.21.15.82:3300/0 conn(0x7f8658136480 0x7f8658139370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> v2:172.21.15.82:3300/0 conn(0x7f8658136480 0x7f8658139370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8650005e30 con 0x7f8658136480 2020-04-02T23:47:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650007540 con 0x7f8658136480 2020-04-02T23:47:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8658135d20 con 0x7f8658136480 2020-04-02T23:47:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8650007920 con 0x7f8658136480 2020-04-02T23:47:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.007+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865813af80 con 0x7f8658136480 2020-04-02T23:47:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.008+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.008+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8658056c50 con 0x7f8658136480 2020-04-02T23:47:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.008+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8650010180 con 0x7f8658136480 2020-04-02T23:47:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.008+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.009+0000 7f8654ff9700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 0x7f863804f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.009+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f86500610b0 con 0x7f8658136480 2020-04-02T23:47:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.009+0000 7f86577fe700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 0x7f863804f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.009+0000 7f86577fe700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 0x7f863804f870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.009+0000 7f86577fe700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 0x7f863804f870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.009+0000 7f86577fe700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 0x7f863804f870 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.026 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.012+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.027 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.012+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f865003c7f0 con 0x7f8658136480 2020-04-02T23:47:09.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.149+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86581410b0 con 0x7f8658136480 2020-04-02T23:47:09.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.150+0000 7f8657fff700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.150+0000 7f8654ff9700 1 -- 172.21.15.82:0/1978050567 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f865003fe10 con 0x7f8658136480 2020-04-02T23:47:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:09.153 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 msgr2=0x7f863804f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 0x7f863804f870 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f8648002f30 tx=0x7f8648007a40).stop 2020-04-02T23:47:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 msgr2=0x7f8658139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f86500032b0 tx=0x7f8650010f40).stop 2020-04-02T23:47:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 shutdown_connections 2020-04-02T23:47:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8658136480 0x7f8658139370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1978050567 >> v2:172.21.15.50:3300/0 conn(0x7f86580a4570 0x7f8658138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 --2- 172.21.15.82:0/1978050567 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f863804d3b0 0x7f863804f870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 >> 172.21.15.82:0/1978050567 conn(0x7f865809de60 msgr2=0x7f865805b010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 shutdown_connections 2020-04-02T23:47:09.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.152+0000 7f865e0c6700 1 -- 172.21.15.82:0/1978050567 wait complete. 2020-04-02T23:47:09.164 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:09.178 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-02T23:47:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.323+0000 7f9e950bb700 1 Processor -- start 2020-04-02T23:47:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.323+0000 7f9e950bb700 1 -- start start 2020-04-02T23:47:09.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.323+0000 7f9e950bb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e90136870 0x7f9e900a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.323+0000 7f9e950bb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e900a5820 con 0x7f9e900a2ab0 2020-04-02T23:47:09.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.323+0000 7f9e950bb700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e900a4130 con 0x7f9e900a4b70 2020-04-02T23:47:09.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.323+0000 7f9e950bb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e900a43d0 con 0x7f9e90136870 2020-04-02T23:47:09.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8e59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e900a4b70 0x7f9e90136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54300/0 (socket says 172.21.15.82:54300) 2020-04-02T23:47:09.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8e59c700 1 -- 172.21.15.82:0/1792290296 learned_addr learned my addr 172.21.15.82:0/1792290296 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/1792290296 >> v2:172.21.15.50:3300/0 conn(0x7f9e90136870 0x7f9e900a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8dd9b700 1 -- 172.21.15.82:0/1792290296 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621981787 0 0) 0x7f9e900a4130 con 0x7f9e900a4b70 2020-04-02T23:47:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8dd9b700 1 -- 172.21.15.82:0/1792290296 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e74003230 con 0x7f9e900a4b70 2020-04-02T23:47:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 -- 172.21.15.82:0/1792290296 >> v1:172.21.15.82:6789/0 conn(0x7f9e900a4b70 legacy=0x7f9e90136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 -- 172.21.15.82:0/1792290296 >> v1:172.21.15.50:6789/0 conn(0x7f9e900a2ab0 legacy=0x7f9e900aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 -- 172.21.15.82:0/1792290296 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900a4670 con 0x7f9e90136870 2020-04-02T23:47:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/1792290296 >> v2:172.21.15.50:3300/0 conn(0x7f9e90136870 0x7f9e900a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e80002f30 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/1792290296 >> v2:172.21.15.50:3300/0 conn(0x7f9e90136870 0x7f9e900a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e80002f30 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/1792290296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e90136870 0x7f9e900a4ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f9e80002f30 tx=0x7f9e80007a40).ready entity=mon.0 client_cookie=9045ae2e5c488479 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/1792290296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e90136870 0x7f9e900a4ff0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9e80002f30 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8dd9b700 1 -- 172.21.15.82:0/1792290296 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e800113c0 con 0x7f9e90136870 2020-04-02T23:47:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/1792290296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e90136870 0x7f9e900a4ff0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9e80002f30 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8dd9b700 1 -- 172.21.15.82:0/1792290296 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80011520 con 0x7f9e90136870 2020-04-02T23:47:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/1792290296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e90136870 0x7f9e900a4ff0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9e80002f30 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e8dd9b700 1 -- 172.21.15.82:0/1792290296 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e80011880 con 0x7f9e90136870 2020-04-02T23:47:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e950bb700 1 -- 172.21.15.82:0/1792290296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e90136870 msgr2=0x7f9e900a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.324+0000 7f9e950bb700 1 --2- 172.21.15.82:0/1792290296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e90136870 0x7f9e900a4ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f9e80002f30 tx=0x7f9e80007a40).stop 2020-04-02T23:47:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.325+0000 7f9e950bb700 1 -- 172.21.15.82:0/1792290296 shutdown_connections 2020-04-02T23:47:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.325+0000 7f9e950bb700 1 --2- 172.21.15.82:0/1792290296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e90136870 0x7f9e900a4ff0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.325+0000 7f9e950bb700 1 -- 172.21.15.82:0/1792290296 >> 172.21.15.82:0/1792290296 conn(0x7f9e9009de60 msgr2=0x7f9e9009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.325+0000 7f9e950bb700 1 -- 172.21.15.82:0/1792290296 shutdown_connections 2020-04-02T23:47:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.325+0000 7f9e950bb700 1 -- 172.21.15.82:0/1792290296 wait complete. 2020-04-02T23:47:09.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.326+0000 7f9e950bb700 1 Processor -- start 2020-04-02T23:47:09.332 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.326+0000 7f9e950bb700 1 -- start start 2020-04-02T23:47:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.326+0000 7f9e950bb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 0x7f9e901387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.326+0000 7f9e950bb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e90138420 con 0x7f9e900a4b70 2020-04-02T23:47:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e950bb700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e90138d30 con 0x7f9e90136870 2020-04-02T23:47:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e950bb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9009f870 con 0x7f9e900a2ab0 2020-04-02T23:47:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e90136870 0x7f9e90130190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54306/0 (socket says 172.21.15.82:54306) 2020-04-02T23:47:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 -- 172.21.15.82:0/91224122 learned_addr learned my addr 172.21.15.82:0/91224122 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8ed9d700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 0x7f9e901387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474120224 0 0) 0x7f9e90138d30 con 0x7f9e90136870 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e6c002fe0 con 0x7f9e90136870 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431533746 0 0) 0x7f9e90138420 con 0x7f9e900a4b70 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e90138d30 con 0x7f9e900a4b70 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3528249092 0 0) 0x7f9e6c002fe0 con 0x7f9e90136870 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9e90138420 con 0x7f9e90136870 2020-04-02T23:47:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f9e80011e40 con 0x7f9e90136870 2020-04-02T23:47:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 msgr2=0x7f9e901387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 0x7f9e901387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 >> v1:172.21.15.82:6789/0 conn(0x7f9e90136870 legacy=0x7f9e90130190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 >> v1:172.21.15.50:6789/0 conn(0x7f9e900a4b70 legacy=0x7f9e90137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e6c004b20 0x7f9e6c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 0x7f9e6c003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9009f870 con 0x7f9e6c004b20 2020-04-02T23:47:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0047f0 con 0x7f9e6c003f10 2020-04-02T23:47:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c00b750 con 0x7f9e900a2ab0 2020-04-02T23:47:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8ed9d700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e6c004b20 0x7f9e6c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8e59c700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 0x7f9e6c003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 -- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 msgr2=0x7f9e6c003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9e900a2ab0 0x7f9e6c003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 -- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e6c004b20 msgr2=0x7f9e6c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e6c004b20 0x7f9e6c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e8f59e700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9009fb10 con 0x7f9e6c003f10 2020-04-02T23:47:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.327+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e90066a10 con 0x7f9e6c003f10 2020-04-02T23:47:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e90065cb0 con 0x7f9e6c003f10 2020-04-02T23:47:09.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e80007530 con 0x7f9e6c003f10 2020-04-02T23:47:09.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80007880 con 0x7f9e6c003f10 2020-04-02T23:47:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e800058b0 con 0x7f9e6c003f10 2020-04-02T23:47:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e70003580 con 0x7f9e6c003f10 2020-04-02T23:47:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.328+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9e80005a10 con 0x7f9e6c003f10 2020-04-02T23:47:09.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.346 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8f59e700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.346 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e7ffff700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 0x7f9e6c057d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.346 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9e80061fe0 con 0x7f9e6c003f10 2020-04-02T23:47:09.346 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8ed9d700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 0x7f9e6c057d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.346 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e7ffff700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] conn(0x7f9e6c05c8f0 0x7f9e6c05ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.346 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e6c05f360 con 0x7f9e6c05c8f0 2020-04-02T23:47:09.346 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e80063480 con 0x7f9e6c003f10 2020-04-02T23:47:09.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8ed9d700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 0x7f9e6c057d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e9005f560 tx=0x7f9e8800ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8e59c700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] conn(0x7f9e6c05c8f0 0x7f9e6c05ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8ed9d700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 0x7f9e6c057d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e9005f560 tx=0x7f9e8800ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8ed9d700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 0x7f9e6c057d50 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f9e9005f560 tx=0x7f9e8800ca80).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8e59c700 1 -- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] conn(0x7f9e6c05c8f0 msgr2=0x7f9e6c05ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:09.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.329+0000 7f9e8e59c700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] conn(0x7f9e6c05c8f0 0x7f9e6c05ed10 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.330+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== osd.0 v2:172.21.15.82:6802/24843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f9e6c05f360 con 0x7f9e6c05c8f0 2020-04-02T23:47:09.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.347+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 --> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e70002680 con 0x7f9e6c05c8f0 2020-04-02T23:47:09.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.347+0000 7f9e7ffff700 1 -- 172.21.15.82:0/91224122 <== osd.0 v2:172.21.15.82:6802/24843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e70002680 con 0x7f9e6c05c8f0 2020-04-02T23:47:09.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] conn(0x7f9e6c05c8f0 msgr2=0x7f9e6c05ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6802/24843,v1:172.21.15.82:6803/24843] conn(0x7f9e6c05c8f0 0x7f9e6c05ed10 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e8f59e700 1 -- 172.21.15.82:0/91224122 reap_dead start 2020-04-02T23:47:09.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 msgr2=0x7f9e6c057d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 0x7f9e6c057d50 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f9e9005f560 tx=0x7f9e8800ca80).stop 2020-04-02T23:47:09.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 msgr2=0x7f9e6c004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f9e800084c0 tx=0x7f9e80007a40).stop 2020-04-02T23:47:09.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 shutdown_connections 2020-04-02T23:47:09.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9e6c055890 0x7f9e6c057d50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 --2- 172.21.15.82:0/91224122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e6c003f10 0x7f9e6c004390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 >> 172.21.15.82:0/91224122 conn(0x7f9e9009de60 msgr2=0x7f9e9009e240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 shutdown_connections 2020-04-02T23:47:09.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.348+0000 7f9e950bb700 1 -- 172.21.15.82:0/91224122 wait complete. 2020-04-02T23:47:09.360 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:09.360 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:09.374 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-02T23:47:09.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.519+0000 7f1edfbf0700 1 Processor -- start 2020-04-02T23:47:09.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.519+0000 7f1edfbf0700 1 -- start start 2020-04-02T23:47:09.530 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edfbf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ed80a2ab0 0x7f1ed80aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.530 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edfbf0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 0x7f1ed80a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edfbf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80a5820 con 0x7f1ed80a4b70 2020-04-02T23:47:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edfbf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80a4130 con 0x7f1ed80a2ab0 2020-04-02T23:47:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edfbf0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80a43d0 con 0x7f1ed8136870 2020-04-02T23:47:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edd18b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1ed80a4b70 0x7f1ed8136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54318/0 (socket says 172.21.15.82:54318) 2020-04-02T23:47:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edd18b700 1 -- 172.21.15.82:0/671564712 learned_addr learned my addr 172.21.15.82:0/671564712 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.520+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> v2:172.21.15.50:3300/0 conn(0x7f1ed80a2ab0 0x7f1ed80aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811765397 0 0) 0x7f1ed80a5820 con 0x7f1ed80a4b70 2020-04-02T23:47:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1ede18d700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 0x7f1ed80a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec0003230 con 0x7f1ed80a4b70 2020-04-02T23:47:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2276538416 0 0) 0x7f1ec0003230 con 0x7f1ed80a4b70 2020-04-02T23:47:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 msgr2=0x7f1ed80a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 0x7f1ed80a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 >> v2:172.21.15.50:3300/0 conn(0x7f1ed80a2ab0 msgr2=0x7f1ed80aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 --2- 172.21.15.82:0/671564712 >> v2:172.21.15.50:3300/0 conn(0x7f1ed80a2ab0 0x7f1ed80aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80a4670 con 0x7f1ed80a4b70 2020-04-02T23:47:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f1ed40016d0 con 0x7f1ed80a4b70 2020-04-02T23:47:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 >> v1:172.21.15.82:6789/0 conn(0x7f1ed80a4b70 legacy=0x7f1ed8136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 0x7f1ec00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ec0004930 0x7f1ec0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80a4130 con 0x7f1ec0004930 2020-04-02T23:47:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80a43d0 con 0x7f1ec0003720 2020-04-02T23:47:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00040f0 con 0x7f1ed8136870 2020-04-02T23:47:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1ede18d700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ec0004930 0x7f1ec0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd18b700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 0x7f1ec00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 -- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 msgr2=0x7f1ec00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8136870 0x7f1ec00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 -- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ec0004930 msgr2=0x7f1ec0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ec0004930 0x7f1ec0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 -- 172.21.15.82:0/671564712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec0003230 con 0x7f1ec0003720 2020-04-02T23:47:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1ede18d700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ec0004930 0x7f1ec0004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).ready entity=mon.1 client_cookie=78140c28f8064244 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc008970 con 0x7f1ec0003720 2020-04-02T23:47:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edd98c700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.521+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc008ad0 con 0x7f1ec0003720 2020-04-02T23:47:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1edc98a700 1 -- 172.21.15.82:0/671564712 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc0130c0 con 0x7f1ec0003720 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1edfbf0700 1 -- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 msgr2=0x7f1ec0003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1edfbf0700 1 --2- 172.21.15.82:0/671564712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec0003720 0x7f1ec0003b40 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).stop 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1ede18d700 1 -- 172.21.15.82:0/671564712 reap_dead start 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1edfbf0700 1 -- 172.21.15.82:0/671564712 shutdown_connections 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1edfbf0700 1 -- 172.21.15.82:0/671564712 >> 172.21.15.82:0/671564712 conn(0x7f1ed809de60 msgr2=0x7f1ed809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1edfbf0700 1 -- 172.21.15.82:0/671564712 shutdown_connections 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.522+0000 7f1edfbf0700 1 -- 172.21.15.82:0/671564712 wait complete. 2020-04-02T23:47:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.523+0000 7f1edfbf0700 1 Processor -- start 2020-04-02T23:47:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.523+0000 7f1edfbf0700 1 -- start start 2020-04-02T23:47:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.523+0000 7f1edfbf0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 0x7f1ed809ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edfbf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ed809f2c0 0x7f1ed8131430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edfbf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80673b0 con 0x7f1ed80a1e70 2020-04-02T23:47:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edfbf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80a5610 con 0x7f1ed809f2c0 2020-04-02T23:47:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edfbf0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed809fff0 con 0x7f1ed8066490 2020-04-02T23:47:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edd18b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1ed80a1e70 0x7f1ed8130d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54330/0 (socket says 172.21.15.82:54330) 2020-04-02T23:47:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edd18b700 1 -- 172.21.15.82:0/2687564757 learned_addr learned my addr 172.21.15.82:0/2687564757 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> v2:172.21.15.50:3300/0 conn(0x7f1ed809f2c0 0x7f1ed8131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edd98c700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 0x7f1ed809ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594484481 0 0) 0x7f1ed80673b0 con 0x7f1ed80a1e70 2020-04-02T23:47:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb8002fe0 con 0x7f1ed80a1e70 2020-04-02T23:47:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1611398657 0 0) 0x7f1eb8002fe0 con 0x7f1ed80a1e70 2020-04-02T23:47:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ed80673b0 con 0x7f1ed80a1e70 2020-04-02T23:47:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f1ed40047a0 con 0x7f1ed80a1e70 2020-04-02T23:47:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 msgr2=0x7f1ed809ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 0x7f1ed809ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 >> v2:172.21.15.50:3300/0 conn(0x7f1ed809f2c0 msgr2=0x7f1ed8131430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 --2- 172.21.15.82:0/2687564757 >> v2:172.21.15.50:3300/0 conn(0x7f1ed809f2c0 0x7f1ed8131430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 >> v1:172.21.15.82:6789/0 conn(0x7f1ed80a1e70 legacy=0x7f1ed8130d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1eb80049b0 0x7f1eb8004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 0x7f1eb8003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80a5610 con 0x7f1eb80049b0 2020-04-02T23:47:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed809fff0 con 0x7f1eb8003d80 2020-04-02T23:47:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8005360 con 0x7f1ed8066490 2020-04-02T23:47:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> v2:172.21.15.50:3300/0 conn(0x7f1ed809f2c0 0x7f1ed8131430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edd98c700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1eb80049b0 0x7f1eb8004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1edd18b700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 0x7f1eb8003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 -- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 msgr2=0x7f1eb8003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1ed8066490 0x7f1eb8003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 -- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1eb80049b0 msgr2=0x7f1eb8004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1eb80049b0 0x7f1eb8004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.524+0000 7f1ede18d700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80a0290 con 0x7f1eb8003d80 2020-04-02T23:47:09.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed80a0530 con 0x7f1eb8003d80 2020-04-02T23:47:09.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed809f750 con 0x7f1eb8003d80 2020-04-02T23:47:09.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed000ce70 con 0x7f1eb8003d80 2020-04-02T23:47:09.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed0005c30 con 0x7f1eb8003d80 2020-04-02T23:47:09.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed0005e20 con 0x7f1eb8003d80 2020-04-02T23:47:09.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.525+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ed80a09d0 con 0x7f1eb8003d80 2020-04-02T23:47:09.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1ed000eaf0 con 0x7f1eb8003d80 2020-04-02T23:47:09.545 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.545 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ede18d700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.546 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ecaffd700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 0x7f1eb8057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.546 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1ed0060d90 con 0x7f1eb8003d80 2020-04-02T23:47:09.546 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1edd98c700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 0x7f1eb8057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.546 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ecaffd700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] conn(0x7f1eb805c7c0 0x7f1eb805ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.546 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1eb805f230 con 0x7f1eb805c7c0 2020-04-02T23:47:09.547 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ed0062250 con 0x7f1eb8003d80 2020-04-02T23:47:09.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1edd98c700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 0x7f1eb8057c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1edd18b700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] conn(0x7f1eb805c7c0 0x7f1eb805ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1edd98c700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 0x7f1eb8057c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.548 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1edd98c700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 0x7f1eb8057c80 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1edd18b700 1 -- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] conn(0x7f1eb805c7c0 msgr2=0x7f1eb805ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:09.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.526+0000 7f1edd18b700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] conn(0x7f1eb805c7c0 0x7f1eb805ebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.550 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.527+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== osd.1 v2:172.21.15.82:6810/24884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f1eb805f230 con 0x7f1eb805c7c0 2020-04-02T23:47:09.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.544+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 --> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ed8056c50 con 0x7f1eb805c7c0 2020-04-02T23:47:09.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1ecaffd700 1 -- 172.21.15.82:0/2687564757 <== osd.1 v2:172.21.15.82:6810/24884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ed8056c50 con 0x7f1eb805c7c0 2020-04-02T23:47:09.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] conn(0x7f1eb805c7c0 msgr2=0x7f1eb805ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6810/24884,v1:172.21.15.82:6811/24884] conn(0x7f1eb805c7c0 0x7f1eb805ebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1ede18d700 1 -- 172.21.15.82:0/2687564757 reap_dead start 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 msgr2=0x7f1eb8057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 0x7f1eb8057c80 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f1ecc002f30 tx=0x7f1ecc0122e0).stop 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 msgr2=0x7f1eb8004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f1ed4001930 tx=0x7f1ed00110b0).stop 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 shutdown_connections 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1eb80557c0 0x7f1eb8057c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 --2- 172.21.15.82:0/2687564757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eb8003d80 0x7f1eb8004200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 >> 172.21.15.82:0/2687564757 conn(0x7f1ed809de60 msgr2=0x7f1ed80a3240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 shutdown_connections 2020-04-02T23:47:09.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.545+0000 7f1edfbf0700 1 -- 172.21.15.82:0/2687564757 wait complete. 2020-04-02T23:47:09.557 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:09.557 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:09.570 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-02T23:47:09.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.715+0000 7fb58f508700 1 Processor -- start 2020-04-02T23:47:09.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.715+0000 7fb58f508700 1 -- start start 2020-04-02T23:47:09.723 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.715+0000 7fb58f508700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb58805c3a0 0x7fb588060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.723 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.715+0000 7fb58f508700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb58805f4a0 0x7fb5880a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.724 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.715+0000 7fb58f508700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5880628e0 con 0x7fb58805f020 2020-04-02T23:47:09.724 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.715+0000 7fb58f508700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5880a95a0 con 0x7fb58805f4a0 2020-04-02T23:47:09.724 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.715+0000 7fb58f508700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb588062b10 con 0x7fb58805c3a0 2020-04-02T23:47:09.724 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb58805c3a0 0x7fb588060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.724 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58caa3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb58805f020 0x7fb5880a79f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54344/0 (socket says 172.21.15.82:54344) 2020-04-02T23:47:09.724 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58caa3700 1 -- 172.21.15.82:0/4133825048 learned_addr learned my addr 172.21.15.82:0/4133825048 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.730 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58daa5700 1 --2- 172.21.15.82:0/4133825048 >> v2:172.21.15.50:3300/0 conn(0x7fb58805f4a0 0x7fb5880a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.730 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 -- 172.21.15.82:0/4133825048 >> v2:172.21.15.50:3300/0 conn(0x7fb58805f4a0 msgr2=0x7fb5880a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.730 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/4133825048 >> v2:172.21.15.50:3300/0 conn(0x7fb58805f4a0 0x7fb5880a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 -- 172.21.15.82:0/4133825048 >> v1:172.21.15.82:6789/0 conn(0x7fb58805f020 legacy=0x7fb5880a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 -- 172.21.15.82:0/4133825048 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58805f8d0 con 0x7fb58805c3a0 2020-04-02T23:47:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb577fff700 1 -- 172.21.15.82:0/4133825048 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396030272 0 0) 0x7fb5880628e0 con 0x7fb58805f020 2020-04-02T23:47:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58daa5700 1 --2- 172.21.15.82:0/4133825048 >> v2:172.21.15.50:3300/0 conn(0x7fb58805f4a0 0x7fb5880a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/4133825048 >> v2:172.21.15.82:3300/0 conn(0x7fb58805c3a0 0x7fb588060cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb584002f30 tx=0x7fb584007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/4133825048 >> v2:172.21.15.82:3300/0 conn(0x7fb58805c3a0 0x7fb588060cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb584002f30 tx=0x7fb584007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/4133825048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805c3a0 0x7fb588060cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).ready entity=mon.1 client_cookie=16eb6b6d18062dab server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/4133825048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805c3a0 0x7fb588060cb0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb577fff700 1 -- 172.21.15.82:0/4133825048 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb584011470 con 0x7fb58805c3a0 2020-04-02T23:47:09.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/4133825048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805c3a0 0x7fb588060cb0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb577fff700 1 -- 172.21.15.82:0/4133825048 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5840115d0 con 0x7fb58805c3a0 2020-04-02T23:47:09.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/4133825048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805c3a0 0x7fb588060cb0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.732 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb577fff700 1 -- 172.21.15.82:0/4133825048 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb584011970 con 0x7fb58805c3a0 2020-04-02T23:47:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58f508700 1 -- 172.21.15.82:0/4133825048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805c3a0 msgr2=0x7fb588060cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.716+0000 7fb58f508700 1 --2- 172.21.15.82:0/4133825048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805c3a0 0x7fb588060cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).stop 2020-04-02T23:47:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.717+0000 7fb58f508700 1 -- 172.21.15.82:0/4133825048 shutdown_connections 2020-04-02T23:47:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.717+0000 7fb58f508700 1 --2- 172.21.15.82:0/4133825048 >> v2:172.21.15.50:3300/0 conn(0x7fb58805f4a0 0x7fb5880a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.717+0000 7fb58f508700 1 --2- 172.21.15.82:0/4133825048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805c3a0 0x7fb588060cb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.717+0000 7fb58f508700 1 -- 172.21.15.82:0/4133825048 >> 172.21.15.82:0/4133825048 conn(0x7fb5880aa630 msgr2=0x7fb5880ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.717+0000 7fb58f508700 1 -- 172.21.15.82:0/4133825048 shutdown_connections 2020-04-02T23:47:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.717+0000 7fb58f508700 1 -- 172.21.15.82:0/4133825048 wait complete. 2020-04-02T23:47:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58f508700 1 Processor -- start 2020-04-02T23:47:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58f508700 1 -- start start 2020-04-02T23:47:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58f508700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb58805c3a0 0x7fb588135720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58f508700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb58805f4a0 0x7fb58809df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58f508700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58809e510 con 0x7fb58805f020 2020-04-02T23:47:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58f508700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb588068840 con 0x7fb58805c3a0 2020-04-02T23:47:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58f508700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58809e7b0 con 0x7fb58805f4a0 2020-04-02T23:47:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58daa5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb58805f4a0 0x7fb58809df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58caa3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb58805f020 0x7fb58809ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54348/0 (socket says 172.21.15.82:54348) 2020-04-02T23:47:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58caa3700 1 -- 172.21.15.82:0/2153284953 learned_addr learned my addr 172.21.15.82:0/2153284953 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58daa5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb58805f4a0 0x7fb58809df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54300/0 (socket says 172.21.15.82:54300) 2020-04-02T23:47:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.718+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/2153284953 >> v2:172.21.15.50:3300/0 conn(0x7fb58805c3a0 0x7fb588135720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 -- 172.21.15.82:0/2153284953 >> v2:172.21.15.50:3300/0 conn(0x7fb58805c3a0 msgr2=0x7fb588135720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.736 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> v2:172.21.15.50:3300/0 conn(0x7fb58805c3a0 0x7fb588135720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.736 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417137888 0 0) 0x7fb58809e510 con 0x7fb58805f020 2020-04-02T23:47:09.736 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 -- 172.21.15.82:0/2153284953 >> v1:172.21.15.82:6789/0 conn(0x7fb58805f020 legacy=0x7fb58809ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.736 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 -- 172.21.15.82:0/2153284953 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58809ea50 con 0x7fb58805f4a0 2020-04-02T23:47:09.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> v2:172.21.15.82:3300/0 conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> v2:172.21.15.82:3300/0 conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb580005e30 con 0x7fb58805f4a0 2020-04-02T23:47:09.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb580007540 con 0x7fb58805f4a0 2020-04-02T23:47:09.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58809f660 con 0x7fb58805f4a0 2020-04-02T23:47:09.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5800078a0 con 0x7fb58805f4a0 2020-04-02T23:47:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.719+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58813af50 con 0x7fb58805f4a0 2020-04-02T23:47:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb58809ec50 con 0x7fb58805f4a0 2020-04-02T23:47:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb58000e3b0 con 0x7fb58805f4a0 2020-04-02T23:47:09.741 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb58daa5700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb5767fc700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb56804d3a0 0x7fb56804f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb5800618a0 con 0x7fb58805f4a0 2020-04-02T23:47:09.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb56804d3a0 0x7fb56804f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb5767fc700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] conn(0x7fb568054540 0x7fb568056960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 --> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb568056f20 con 0x7fb568054540 2020-04-02T23:47:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb580066cc0 con 0x7fb58805f4a0 2020-04-02T23:47:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb56804d3a0 0x7fb56804f860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.720+0000 7fb58caa3700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] conn(0x7fb568054540 0x7fb568056960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.721+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb56804d3a0 0x7fb56804f860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.721+0000 7fb58d2a4700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb56804d3a0 0x7fb56804f860 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.721+0000 7fb58caa3700 1 -- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] conn(0x7fb568054540 msgr2=0x7fb568056960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.721+0000 7fb58caa3700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] conn(0x7fb568054540 0x7fb568056960 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.721+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== osd.2 v2:172.21.15.82:6818/24937 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fb568056f20 con 0x7fb568054540 2020-04-02T23:47:09.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.738+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 --> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb58813cf70 con 0x7fb568054540 2020-04-02T23:47:09.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb5767fc700 1 -- 172.21.15.82:0/2153284953 <== osd.2 v2:172.21.15.82:6818/24937 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb58813cf70 con 0x7fb568054540 2020-04-02T23:47:09.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] conn(0x7fb568054540 msgr2=0x7fb568056960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6818/24937,v1:172.21.15.82:6819/24937] conn(0x7fb568054540 0x7fb568056960 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb56804d3a0 msgr2=0x7fb56804f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb56804d3a0 0x7fb56804f860 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb584007a40).stop 2020-04-02T23:47:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 msgr2=0x7fb58809df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fb5881350f0 tx=0x7fb580010d20).stop 2020-04-02T23:47:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58daa5700 1 -- 172.21.15.82:0/2153284953 reap_dead start 2020-04-02T23:47:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 shutdown_connections 2020-04-02T23:47:09.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 --2- 172.21.15.82:0/2153284953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58805f4a0 0x7fb58809df90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 >> 172.21.15.82:0/2153284953 conn(0x7fb5880aa630 msgr2=0x7fb5880abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 shutdown_connections 2020-04-02T23:47:09.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.739+0000 7fb58f508700 1 -- 172.21.15.82:0/2153284953 wait complete. 2020-04-02T23:47:09.751 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:09.751 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:09.765 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-02T23:47:09.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.909+0000 7f68bc4ba700 1 Processor -- start 2020-04-02T23:47:09.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.909+0000 7f68bc4ba700 1 -- start start 2020-04-02T23:47:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68bc4ba700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68b40a2ab0 0x7f68b40aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68bc4ba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 0x7f68b40a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68bc4ba700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40a5820 con 0x7f68b4136160 2020-04-02T23:47:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68bc4ba700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b40a4130 con 0x7f68b40a2ab0 2020-04-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68bc4ba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40a43d0 con 0x7f68b40a4b70 2020-04-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68baa57700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f68b4136160 0x7f68b41365f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54360/0 (socket says 172.21.15.82:54360) 2020-04-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68baa57700 1 -- 172.21.15.82:0/3036450840 learned_addr learned my addr 172.21.15.82:0/3036450840 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082266743 0 0) 0x7f68b40a5820 con 0x7f68b4136160 2020-04-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f689c003230 con 0x7f68b4136160 2020-04-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9a55700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 0x7f68b40a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68ba256700 1 --2- 172.21.15.82:0/3036450840 >> v2:172.21.15.50:3300/0 conn(0x7f68b40a2ab0 0x7f68b40aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3822659043 0 0) 0x7f689c003230 con 0x7f68b4136160 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 msgr2=0x7f68b40a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 0x7f68b40a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 >> v2:172.21.15.50:3300/0 conn(0x7f68b40a2ab0 msgr2=0x7f68b40aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 --2- 172.21.15.82:0/3036450840 >> v2:172.21.15.50:3300/0 conn(0x7f68b40a2ab0 0x7f68b40aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40a4670 con 0x7f68b4136160 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f68b00016d0 con 0x7f68b4136160 2020-04-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 >> v1:172.21.15.82:6789/0 conn(0x7f68b4136160 legacy=0x7f68b41365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 0x7f689c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c003b80 0x7f689c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40a4130 con 0x7f689c003b80 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40a43d0 con 0x7f689c0045c0 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c005050 con 0x7f68b40a4b70 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68ba256700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 0x7f689c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.910+0000 7f68b9a55700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c003b80 0x7f689c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 -- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 msgr2=0x7f689c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68b40a4b70 0x7f689c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 -- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c003b80 msgr2=0x7f689c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c003b80 0x7f689c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 -- 172.21.15.82:0/3036450840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c003230 con 0x7f689c0045c0 2020-04-02T23:47:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68b00013e0 tx=0x7f68b40a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68b00013e0 tx=0x7f68b40a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f68b00013e0 tx=0x7f68b40a2e90).ready entity=mon.1 client_cookie=bd8542abf9a6194f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f68b00013e0 tx=0x7f68b40a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b000e160 con 0x7f689c0045c0 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f68b00013e0 tx=0x7f68b40a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f68b00013e0 tx=0x7f68b40a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b000e2c0 con 0x7f689c0045c0 2020-04-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68b9254700 1 -- 172.21.15.82:0/3036450840 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b000e6e0 con 0x7f689c0045c0 2020-04-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68bc4ba700 1 -- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 msgr2=0x7f689c004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68bc4ba700 1 --2- 172.21.15.82:0/3036450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c0045c0 0x7f689c004a20 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f68b00013e0 tx=0x7f68b40a2e90).stop 2020-04-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68baa57700 1 -- 172.21.15.82:0/3036450840 reap_dead start 2020-04-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68bc4ba700 1 -- 172.21.15.82:0/3036450840 shutdown_connections 2020-04-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68bc4ba700 1 -- 172.21.15.82:0/3036450840 >> 172.21.15.82:0/3036450840 conn(0x7f68b409de60 msgr2=0x7f68b409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68bc4ba700 1 -- 172.21.15.82:0/3036450840 shutdown_connections 2020-04-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.911+0000 7f68bc4ba700 1 -- 172.21.15.82:0/3036450840 wait complete. 2020-04-02T23:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.912+0000 7f68bc4ba700 1 Processor -- start 2020-04-02T23:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.912+0000 7f68bc4ba700 1 -- start start 2020-04-02T23:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68bc4ba700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68b4064280 0x7f68b4143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68bc4ba700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68b4064eb0 0x7f68b414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68bc4ba700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b4065340 con 0x7f68b4063ea0 2020-04-02T23:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68bc4ba700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b4143b80 con 0x7f68b4064eb0 2020-04-02T23:47:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68bc4ba700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b4063d20 con 0x7f68b4064280 2020-04-02T23:47:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68b4064280 0x7f68b4143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68b4064280 0x7f68b4143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54320/0 (socket says 172.21.15.82:54320) 2020-04-02T23:47:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 -- 172.21.15.82:0/1667238970 learned_addr learned my addr 172.21.15.82:0/1667238970 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68baa57700 1 --2- 172.21.15.82:0/1667238970 >> v2:172.21.15.50:3300/0 conn(0x7f68b4064eb0 0x7f68b414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 -- 172.21.15.82:0/1667238970 >> v2:172.21.15.50:3300/0 conn(0x7f68b4064eb0 msgr2=0x7f68b414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> v2:172.21.15.50:3300/0 conn(0x7f68b4064eb0 0x7f68b414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 -- 172.21.15.82:0/1667238970 >> v1:172.21.15.50:6789/0 conn(0x7f68b4063ea0 legacy=0x7f68b4132410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 -- 172.21.15.82:0/1667238970 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40673b0 con 0x7f68b4064280 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> v2:172.21.15.82:3300/0 conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> v2:172.21.15.82:3300/0 conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.913+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a4005e90 con 0x7f68b4064280 2020-04-02T23:47:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.914+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a4007160 con 0x7f68b4064280 2020-04-02T23:47:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.914+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b4064a50 con 0x7f68b4064280 2020-04-02T23:47:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.914+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a4007580 con 0x7f68b4064280 2020-04-02T23:47:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.914+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b4063740 con 0x7f68b4064280 2020-04-02T23:47:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.914+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.914+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68b40a36f0 con 0x7f68b4064280 2020-04-02T23:47:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f68a40083c0 con 0x7f68b4064280 2020-04-02T23:47:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68b9a55700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68a37fe700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f689404d650 0x7f689404fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f68a4060fc0 con 0x7f68b4064280 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68ba256700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f689404d650 0x7f689404fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68a37fe700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] conn(0x7f6894054700 0x7f6894056b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 --> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68940570e0 con 0x7f6894054700 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68a4062420 con 0x7f68b4064280 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68ba256700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f689404d650 0x7f689404fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68b41131e0 tx=0x7f68ac007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68baa57700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] conn(0x7f6894054700 0x7f6894056b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68ba256700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f689404d650 0x7f689404fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68b41131e0 tx=0x7f68ac007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68ba256700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f689404d650 0x7f689404fb10 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f68b41131e0 tx=0x7f68ac007d00).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68baa57700 1 -- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] conn(0x7f6894054700 msgr2=0x7f6894056b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.915+0000 7f68baa57700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] conn(0x7f6894054700 0x7f6894056b20 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.916+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== osd.3 v2:172.21.15.82:6826/24965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f68940570e0 con 0x7f6894054700 2020-04-02T23:47:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.933+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 --> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68b4064c10 con 0x7f6894054700 2020-04-02T23:47:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.933+0000 7f68a37fe700 1 -- 172.21.15.82:0/1667238970 <== osd.3 v2:172.21.15.82:6826/24965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68b0001190 con 0x7f6894054700 2020-04-02T23:47:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] conn(0x7f6894054700 msgr2=0x7f6894056b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6826/24965,v1:172.21.15.82:6827/24965] conn(0x7f6894054700 0x7f6894056b20 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f689404d650 msgr2=0x7f689404fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f689404d650 0x7f689404fb10 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f68b41131e0 tx=0x7f68ac007d00).stop 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 msgr2=0x7f68b4143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f68a4003070 tx=0x7f68a400c400).stop 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68baa57700 1 -- 172.21.15.82:0/1667238970 reap_dead start 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 shutdown_connections 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 --2- 172.21.15.82:0/1667238970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4064280 0x7f68b4143720 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 >> 172.21.15.82:0/1667238970 conn(0x7f68b409de60 msgr2=0x7f68b40a82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 shutdown_connections 2020-04-02T23:47:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:09.934+0000 7f68bc4ba700 1 -- 172.21.15.82:0/1667238970 wait complete. 2020-04-02T23:47:09.945 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:09.946 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:09.958 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-02T23:47:10.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.104+0000 7f29e31d7700 1 Processor -- start 2020-04-02T23:47:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.104+0000 7f29e31d7700 1 -- start start 2020-04-02T23:47:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29e31d7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 0x7f29dc1414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29e31d7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0a4be0 con 0x7f29dc136e50 2020-04-02T23:47:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29e31d7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0a49e0 con 0x7f29dc0ab200 2020-04-02T23:47:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29e31d7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0a4180 con 0x7f29dc0a4570 2020-04-02T23:47:10.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29e0f73700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f29dc0ab200 0x7f29dc135d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54378/0 (socket says 172.21.15.82:54378) 2020-04-02T23:47:10.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29e0f73700 1 -- 172.21.15.82:0/3638447896 learned_addr learned my addr 172.21.15.82:0/3638447896 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:10.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134629164 0 0) 0x7f29dc0a49e0 con 0x7f29dc0ab200 2020-04-02T23:47:10.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c8003230 con 0x7f29dc0ab200 2020-04-02T23:47:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.105+0000 7f29e1774700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 0x7f29dc1414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2527458359 0 0) 0x7f29c8003230 con 0x7f29dc0ab200 2020-04-02T23:47:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 msgr2=0x7f29dc1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 0x7f29dc1414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 >> v1:172.21.15.50:6789/0 conn(0x7f29dc136e50 legacy=0x7f29dc136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc136b90 con 0x7f29dc0ab200 2020-04-02T23:47:10.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f29cc0016d0 con 0x7f29dc0ab200 2020-04-02T23:47:10.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 >> v1:172.21.15.82:6789/0 conn(0x7f29dc0ab200 legacy=0x7f29dc135d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 0x7f29c80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8004930 0x7f29c8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8005300 con 0x7f29c8004930 2020-04-02T23:47:10.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8004110 con 0x7f29c8003720 2020-04-02T23:47:10.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80042d0 con 0x7f29dc0a4570 2020-04-02T23:47:10.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29dbfff700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 0x7f29c80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e1774700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8004930 0x7f29c8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 -- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 msgr2=0x7f29c80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f29dc0a4570 0x7f29c80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 -- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8004930 msgr2=0x7f29c8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8004930 0x7f29c8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 -- 172.21.15.82:0/3638447896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c8003230 con 0x7f29c8003720 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e1774700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8004930 0x7f29c8004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29cc0013e0 tx=0x7f29dc136d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29cc0013e0 tx=0x7f29dc136d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f29cc0013e0 tx=0x7f29dc136d20).ready entity=mon.1 client_cookie=ad6872ab92e1a723 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f29cc0013e0 tx=0x7f29dc136d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc00e160 con 0x7f29c8003720 2020-04-02T23:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f29cc0013e0 tx=0x7f29dc136d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f29cc0013e0 tx=0x7f29dc136d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00e2c0 con 0x7f29c8003720 2020-04-02T23:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29db7fe700 1 -- 172.21.15.82:0/3638447896 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc00e660 con 0x7f29c8003720 2020-04-02T23:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e31d7700 1 -- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 msgr2=0x7f29c8003b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e31d7700 1 --2- 172.21.15.82:0/3638447896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8003720 0x7f29c8003b60 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f29cc0013e0 tx=0x7f29dc136d20).stop 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.106+0000 7f29e1774700 1 -- 172.21.15.82:0/3638447896 reap_dead start 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.107+0000 7f29e31d7700 1 -- 172.21.15.82:0/3638447896 shutdown_connections 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.107+0000 7f29e31d7700 1 -- 172.21.15.82:0/3638447896 >> 172.21.15.82:0/3638447896 conn(0x7f29dc09de60 msgr2=0x7f29dc09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.107+0000 7f29e31d7700 1 -- 172.21.15.82:0/3638447896 shutdown_connections 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.107+0000 7f29e31d7700 1 -- 172.21.15.82:0/3638447896 wait complete. 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.108+0000 7f29e31d7700 1 Processor -- start 2020-04-02T23:47:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.108+0000 7f29e31d7700 1 -- start start 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e31d7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29dc062120 0x7f29dc062a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e31d7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29dc130d20 0x7f29dc1311b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e31d7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc064760 con 0x7f29dc0a7db0 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e31d7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc064a00 con 0x7f29dc062120 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e31d7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc064ca0 con 0x7f29dc130d20 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29dc130d20 0x7f29dc1311b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29dc130d20 0x7f29dc1311b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54342/0 (socket says 172.21.15.82:54342) 2020-04-02T23:47:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 -- 172.21.15.82:0/3178500819 learned_addr learned my addr 172.21.15.82:0/3178500819 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29dbfff700 1 --2- 172.21.15.82:0/3178500819 >> v2:172.21.15.50:3300/0 conn(0x7f29dc062120 0x7f29dc062a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 -- 172.21.15.82:0/3178500819 >> v2:172.21.15.50:3300/0 conn(0x7f29dc062120 msgr2=0x7f29dc062a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> v2:172.21.15.50:3300/0 conn(0x7f29dc062120 0x7f29dc062a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 -- 172.21.15.82:0/3178500819 >> v1:172.21.15.50:6789/0 conn(0x7f29dc0a7db0 legacy=0x7f29dc061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 -- 172.21.15.82:0/3178500819 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc064f40 con 0x7f29dc130d20 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> v2:172.21.15.82:3300/0 conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> v2:172.21.15.82:3300/0 conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d4005e20 con 0x7f29dc130d20 2020-04-02T23:47:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d40123c0 con 0x7f29dc130d20 2020-04-02T23:47:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc136010 con 0x7f29dc130d20 2020-04-02T23:47:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d40127e0 con 0x7f29dc130d20 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.109+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc131610 con 0x7f29dc130d20 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.110+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.110+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29dc061770 con 0x7f29dc130d20 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.110+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f29d4012940 con 0x7f29dc130d20 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.110+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.110+0000 7f29e1774700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.110+0000 7f29d9ffb700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f29bc04d500 0x7f29bc04f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.110+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f29d4061050 con 0x7f29dc130d20 2020-04-02T23:47:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f29bc04d500 0x7f29bc04f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29d9ffb700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] conn(0x7f29bc054720 0x7f29bc056b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 --> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29bc057100 con 0x7f29bc054720 2020-04-02T23:47:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29d4062510 con 0x7f29dc130d20 2020-04-02T23:47:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f29bc04d500 0x7f29bc04f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29dc064670 tx=0x7f29dc136d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29dbfff700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] conn(0x7f29bc054720 0x7f29bc056b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f29bc04d500 0x7f29bc04f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29dc064670 tx=0x7f29dc136d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29e0f73700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f29bc04d500 0x7f29bc04f9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f29dc064670 tx=0x7f29dc136d20).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29dbfff700 1 -- 172.21.15.82:0/3178500819 >> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] conn(0x7f29bc054720 msgr2=0x7f29bc056b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:10.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.111+0000 7f29dbfff700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] conn(0x7f29bc054720 0x7f29bc056b40 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.112+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== osd.4 v2:172.21.15.50:6800/24224 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f29bc057100 con 0x7f29bc054720 2020-04-02T23:47:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.129+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 --> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29dc056c50 con 0x7f29bc054720 2020-04-02T23:47:10.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29d9ffb700 1 -- 172.21.15.82:0/3178500819 <== osd.4 v2:172.21.15.50:6800/24224 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29dc056c50 con 0x7f29bc054720 2020-04-02T23:47:10.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 >> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] conn(0x7f29bc054720 msgr2=0x7f29bc056b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.50:6800/24224,v1:172.21.15.50:6801/24224] conn(0x7f29bc054720 0x7f29bc056b40 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f29bc04d500 msgr2=0x7f29bc04f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f29bc04d500 0x7f29bc04f9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f29dc064670 tx=0x7f29dc136d20).stop 2020-04-02T23:47:10.133 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 msgr2=0x7f29dc1311b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f29cc0010d0 tx=0x7f29d4010b50).stop 2020-04-02T23:47:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e1774700 1 -- 172.21.15.82:0/3178500819 reap_dead start 2020-04-02T23:47:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 shutdown_connections 2020-04-02T23:47:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 --2- 172.21.15.82:0/3178500819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc130d20 0x7f29dc1311b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 >> 172.21.15.82:0/3178500819 conn(0x7f29dc09de60 msgr2=0x7f29dc068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 shutdown_connections 2020-04-02T23:47:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.130+0000 7f29e31d7700 1 -- 172.21.15.82:0/3178500819 wait complete. 2020-04-02T23:47:10.142 INFO:teuthology.orchestra.run.smithi082.stdout:60129542151 2020-04-02T23:47:10.142 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:10.155 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-02T23:47:10.301 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.299+0000 7f8b655c2700 1 Processor -- start 2020-04-02T23:47:10.301 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.299+0000 7f8b655c2700 1 -- start start 2020-04-02T23:47:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.300+0000 7f8b655c2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 0x7f8b60066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.300+0000 7f8b655c2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b6009e7d0 0x7f8b6013c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.300+0000 7f8b655c2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600675c0 con 0x7f8b6013ce50 2020-04-02T23:47:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.300+0000 7f8b655c2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600abc50 con 0x7f8b6009e7d0 2020-04-02T23:47:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.300+0000 7f8b655c2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013c2b0 con 0x7f8b6009e3f0 2020-04-02T23:47:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.300+0000 7f8b5e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b6009e7d0 0x7f8b6013c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 0x7f8b60066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b6013ce50 0x7f8b600aaf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58368/0 (socket says 172.21.15.82:58368) 2020-04-02T23:47:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5f7fe700 1 -- 172.21.15.82:0/2173606311 learned_addr learned my addr 172.21.15.82:0/2173606311 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5dffb700 1 -- 172.21.15.82:0/2173606311 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283928962 0 0) 0x7f8b600675c0 con 0x7f8b6013ce50 2020-04-02T23:47:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5dffb700 1 -- 172.21.15.82:0/2173606311 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b44003230 con 0x7f8b6013ce50 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 -- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 msgr2=0x7f8b60066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 0x7f8b60066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 -- 172.21.15.82:0/2173606311 >> v1:172.21.15.50:6789/0 conn(0x7f8b6013ce50 legacy=0x7f8b600aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 -- 172.21.15.82:0/2173606311 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6013c550 con 0x7f8b6009e7d0 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/2173606311 >> v2:172.21.15.50:3300/0 conn(0x7f8b6009e7d0 0x7f8b6013c9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/2173606311 >> v2:172.21.15.50:3300/0 conn(0x7f8b6009e7d0 0x7f8b6013c9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6009e7d0 0x7f8b6013c9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).ready entity=mon.0 client_cookie=e3d9e997df89c825 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6009e7d0 0x7f8b6013c9f0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.312 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5dffb700 1 -- 172.21.15.82:0/2173606311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b50011310 con 0x7f8b6009e7d0 2020-04-02T23:47:10.312 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6009e7d0 0x7f8b6013c9f0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.312 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6009e7d0 0x7f8b6013c9f0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.312 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5dffb700 1 -- 172.21.15.82:0/2173606311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50011470 con 0x7f8b6009e7d0 2020-04-02T23:47:10.312 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b5dffb700 1 -- 172.21.15.82:0/2173606311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b50011850 con 0x7f8b6009e7d0 2020-04-02T23:47:10.312 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b655c2700 1 -- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6009e7d0 msgr2=0x7f8b6013c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.312 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.301+0000 7f8b655c2700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6009e7d0 0x7f8b6013c9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).stop 2020-04-02T23:47:10.313 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.302+0000 7f8b655c2700 1 -- 172.21.15.82:0/2173606311 shutdown_connections 2020-04-02T23:47:10.313 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.302+0000 7f8b655c2700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 0x7f8b60066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.313 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.302+0000 7f8b655c2700 1 --2- 172.21.15.82:0/2173606311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6009e7d0 0x7f8b6013c9f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.313 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.302+0000 7f8b655c2700 1 -- 172.21.15.82:0/2173606311 >> 172.21.15.82:0/2173606311 conn(0x7f8b600abdf0 msgr2=0x7f8b600ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.313 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.302+0000 7f8b655c2700 1 -- 172.21.15.82:0/2173606311 shutdown_connections 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.302+0000 7f8b655c2700 1 -- 172.21.15.82:0/2173606311 wait complete. 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b655c2700 1 Processor -- start 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b655c2700 1 -- start start 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b655c2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 0x7f8b60135a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b655c2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b600a90e0 0x7f8b601368a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b655c2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60138980 con 0x7f8b60138db0 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b655c2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b60136d00 con 0x7f8b600a90e0 2020-04-02T23:47:10.314 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b655c2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601364a0 con 0x7f8b6009e3f0 2020-04-02T23:47:10.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b5e7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b600a90e0 0x7f8b601368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b5e7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b600a90e0 0x7f8b601368a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54352/0 (socket says 172.21.15.82:54352) 2020-04-02T23:47:10.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b5e7fc700 1 -- 172.21.15.82:0/1367204165 learned_addr learned my addr 172.21.15.82:0/1367204165 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:10.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.303+0000 7f8b5effd700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 0x7f8b60135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 -- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 msgr2=0x7f8b60135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b6009e3f0 0x7f8b60135a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.315 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 -- 172.21.15.82:0/1367204165 >> v1:172.21.15.50:6789/0 conn(0x7f8b60138db0 legacy=0x7f8b601326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 -- 172.21.15.82:0/1367204165 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60139760 con 0x7f8b600a90e0 2020-04-02T23:47:10.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> v2:172.21.15.82:3300/0 conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> v2:172.21.15.82:3300/0 conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b50011810 con 0x7f8b600a90e0 2020-04-02T23:47:10.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60139a00 con 0x7f8b600a90e0 2020-04-02T23:47:10.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50007150 con 0x7f8b600a90e0 2020-04-02T23:47:10.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b50007530 con 0x7f8b600a90e0 2020-04-02T23:47:10.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.304+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b601393e0 con 0x7f8b600a90e0 2020-04-02T23:47:10.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b60138b10 con 0x7f8b600a90e0 2020-04-02T23:47:10.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8b500056c0 con 0x7f8b600a90e0 2020-04-02T23:47:10.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b5e7fc700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b4ffff700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8b3c04d3e0 0x7f8b3c04f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8b50061a90 con 0x7f8b600a90e0 2020-04-02T23:47:10.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b5effd700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8b3c04d3e0 0x7f8b3c04f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b4ffff700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] conn(0x7f8b3c054580 0x7f8b3c0569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 --> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b3c056f60 con 0x7f8b3c054580 2020-04-02T23:47:10.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.305+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b50062fb0 con 0x7f8b600a90e0 2020-04-02T23:47:10.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.306+0000 7f8b5effd700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8b3c04d3e0 0x7f8b3c04f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b54002f30 tx=0x7f8b5400d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.306+0000 7f8b5effd700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8b3c04d3e0 0x7f8b3c04f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b54002f30 tx=0x7f8b5400d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.306+0000 7f8b5effd700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8b3c04d3e0 0x7f8b3c04f8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f8b54002f30 tx=0x7f8b5400d8b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.306+0000 7f8b5f7fe700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] conn(0x7f8b3c054580 0x7f8b3c0569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.306+0000 7f8b5f7fe700 1 -- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] conn(0x7f8b3c054580 msgr2=0x7f8b3c0569a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:10.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.306+0000 7f8b5f7fe700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] conn(0x7f8b3c054580 0x7f8b3c0569a0 crc :-1 s=READY pgs=14 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.307+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== osd.5 v2:172.21.15.50:6808/24272 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f8b3c056f60 con 0x7f8b3c054580 2020-04-02T23:47:10.326 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.324+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 --> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b6009ea10 con 0x7f8b3c054580 2020-04-02T23:47:10.326 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b4ffff700 1 -- 172.21.15.82:0/1367204165 <== osd.5 v2:172.21.15.50:6808/24272 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b6009ea10 con 0x7f8b3c054580 2020-04-02T23:47:10.327 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] conn(0x7f8b3c054580 msgr2=0x7f8b3c0569a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.327 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.50:6808/24272,v1:172.21.15.50:6809/24272] conn(0x7f8b3c054580 0x7f8b3c0569a0 crc :-1 s=READY pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8b3c04d3e0 msgr2=0x7f8b3c04f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f8b3c04d3e0 0x7f8b3c04f8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f8b54002f30 tx=0x7f8b5400d8b0).stop 2020-04-02T23:47:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 msgr2=0x7f8b601368a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f8b50002f30 tx=0x7f8b50007a40).stop 2020-04-02T23:47:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b5f7fe700 1 -- 172.21.15.82:0/1367204165 reap_dead start 2020-04-02T23:47:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 shutdown_connections 2020-04-02T23:47:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 --2- 172.21.15.82:0/1367204165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b600a90e0 0x7f8b601368a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 >> 172.21.15.82:0/1367204165 conn(0x7f8b600abdf0 msgr2=0x7f8b600aa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 shutdown_connections 2020-04-02T23:47:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.325+0000 7f8b655c2700 1 -- 172.21.15.82:0/1367204165 wait complete. 2020-04-02T23:47:10.337 INFO:teuthology.orchestra.run.smithi082.stdout:60129542151 2020-04-02T23:47:10.337 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:10.350 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-02T23:47:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.494+0000 7fb46759e700 1 Processor -- start 2020-04-02T23:47:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.494+0000 7fb46759e700 1 -- start start 2020-04-02T23:47:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb46759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb4680a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb46759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb468135d20 0x7fb468136170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb46759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46805f1e0 con 0x7fb4680a7090 2020-04-02T23:47:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb46759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4680a67b0 con 0x7fb4680a2300 2020-04-02T23:47:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb46759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4680a6a50 con 0x7fb468135d20 2020-04-02T23:47:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb466d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb468135d20 0x7fb468136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb466d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb468135d20 0x7fb468136170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54360/0 (socket says 172.21.15.82:54360) 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb466d9d700 1 -- 172.21.15.82:0/3155654600 learned_addr learned my addr 172.21.15.82:0/3155654600 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.495+0000 7fb465d9b700 1 --1- 172.21.15.82:0/3155654600 >> v1:172.21.15.82:6789/0 conn(0x7fb4680a7090 0x7fb468135610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54410/0 (socket says 172.21.15.82:54410) 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46659c700 1 --2- 172.21.15.82:0/3155654600 >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb4680a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 -- 172.21.15.82:0/3155654600 >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 msgr2=0x7fb4680a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3155654600 >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb4680a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 -- 172.21.15.82:0/3155654600 >> v1:172.21.15.82:6789/0 conn(0x7fb4680a7090 legacy=0x7fb468135610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 -- 172.21.15.82:0/3155654600 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4680a6cf0 con 0x7fb468135d20 2020-04-02T23:47:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46559a700 1 -- 172.21.15.82:0/3155654600 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231496308 0 0) 0x7fb46805f1e0 con 0x7fb4680a7090 2020-04-02T23:47:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46659c700 1 --2- 172.21.15.82:0/3155654600 >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb4680a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3155654600 >> v2:172.21.15.82:3300/0 conn(0x7fb468135d20 0x7fb468136170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3155654600 >> v2:172.21.15.82:3300/0 conn(0x7fb468135d20 0x7fb468136170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3155654600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb468135d20 0x7fb468136170 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).ready entity=mon.1 client_cookie=248f3fca5f0d7730 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3155654600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb468135d20 0x7fb468136170 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46559a700 1 -- 172.21.15.82:0/3155654600 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb46000a160 con 0x7fb468135d20 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3155654600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb468135d20 0x7fb468136170 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3155654600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb468135d20 0x7fb468136170 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46559a700 1 -- 172.21.15.82:0/3155654600 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46000a2c0 con 0x7fb468135d20 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46559a700 1 -- 172.21.15.82:0/3155654600 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb46000a660 con 0x7fb468135d20 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 -- 172.21.15.82:0/3155654600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb468135d20 msgr2=0x7fb468136170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 --2- 172.21.15.82:0/3155654600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb468135d20 0x7fb468136170 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).stop 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 -- 172.21.15.82:0/3155654600 shutdown_connections 2020-04-02T23:47:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 --2- 172.21.15.82:0/3155654600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb468135d20 0x7fb468136170 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 --2- 172.21.15.82:0/3155654600 >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb4680a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 -- 172.21.15.82:0/3155654600 >> 172.21.15.82:0/3155654600 conn(0x7fb46809de60 msgr2=0x7fb46809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 -- 172.21.15.82:0/3155654600 shutdown_connections 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.496+0000 7fb46759e700 1 -- 172.21.15.82:0/3155654600 wait complete. 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.497+0000 7fb46759e700 1 Processor -- start 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.497+0000 7fb46759e700 1 -- start start 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb46759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb46809f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb46759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb46759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46809f040 con 0x7fb4680a7090 2020-04-02T23:47:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb46759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46809ee30 con 0x7fb4680a2300 2020-04-02T23:47:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb46759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46809fcc0 con 0x7fb468135d20 2020-04-02T23:47:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb465d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4680a7090 0x7fb46812a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58388/0 (socket says 172.21.15.82:58388) 2020-04-02T23:47:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb465d9b700 1 -- 172.21.15.82:0/3703112485 learned_addr learned my addr 172.21.15.82:0/3703112485 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb466d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb46659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb46809f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157859192 0 0) 0x7fb46809f040 con 0x7fb4680a7090 2020-04-02T23:47:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb44c002fe0 con 0x7fb4680a7090 2020-04-02T23:47:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb466d9d700 1 -- 172.21.15.82:0/3703112485 >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 msgr2=0x7fb46809f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.498+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> v2:172.21.15.50:3300/0 conn(0x7fb4680a2300 0x7fb46809f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 -- 172.21.15.82:0/3703112485 >> v1:172.21.15.50:6789/0 conn(0x7fb4680a7090 legacy=0x7fb46812a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 -- 172.21.15.82:0/3703112485 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46812cb10 con 0x7fb468135d20 2020-04-02T23:47:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb460005a40 con 0x7fb468135d20 2020-04-02T23:47:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460005ba0 con 0x7fb468135d20 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46812cdb0 con 0x7fb468135d20 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb460007150 con 0x7fb468135d20 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.499+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46812a7f0 con 0x7fb468135d20 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb46812d250 con 0x7fb468135d20 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb460007350 con 0x7fb468135d20 2020-04-02T23:47:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb466d9d700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb45f7fe700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb44c04d8e0 0x7fb44c04fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb460061d30 con 0x7fb468135d20 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb46659c700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb44c04d8e0 0x7fb44c04fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb45f7fe700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] conn(0x7fb44c054a10 0x7fb44c056e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 --> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb44c0573f0 con 0x7fb44c054a10 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.500+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4600631d0 con 0x7fb468135d20 2020-04-02T23:47:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.501+0000 7fb46659c700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb44c04d8e0 0x7fb44c04fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb45000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.501+0000 7fb465d9b700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] conn(0x7fb44c054a10 0x7fb44c056e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.501+0000 7fb46659c700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb44c04d8e0 0x7fb44c04fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb45000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.501+0000 7fb46659c700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb44c04d8e0 0x7fb44c04fda0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb45000e190).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.501+0000 7fb465d9b700 1 -- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] conn(0x7fb44c054a10 msgr2=0x7fb44c056e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.501+0000 7fb465d9b700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] conn(0x7fb44c054a10 0x7fb44c056e30 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.514 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.502+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== osd.6 v2:172.21.15.50:6816/24303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fb44c0573f0 con 0x7fb44c054a10 2020-04-02T23:47:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.519+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 --> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb468131b80 con 0x7fb44c054a10 2020-04-02T23:47:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.519+0000 7fb45f7fe700 1 -- 172.21.15.82:0/3703112485 <== osd.6 v2:172.21.15.50:6816/24303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb468131b80 con 0x7fb44c054a10 2020-04-02T23:47:10.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] conn(0x7fb44c054a10 msgr2=0x7fb44c056e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:6816/24303,v1:172.21.15.50:6817/24303] conn(0x7fb44c054a10 0x7fb44c056e30 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb44c04d8e0 msgr2=0x7fb44c04fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb44c04d8e0 0x7fb44c04fda0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb45000e190).stop 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 msgr2=0x7fb4681314e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 --2- 172.21.15.82:0/3703112485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468135d20 0x7fb4681314e0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fb4600032b0 tx=0x7fb460007dc0).stop 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb466d9d700 1 -- 172.21.15.82:0/3703112485 reap_dead start 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 shutdown_connections 2020-04-02T23:47:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 >> 172.21.15.82:0/3703112485 conn(0x7fb46809de60 msgr2=0x7fb4680a77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 shutdown_connections 2020-04-02T23:47:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.520+0000 7fb46759e700 1 -- 172.21.15.82:0/3703112485 wait complete. 2020-04-02T23:47:10.531 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:10.532 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:10.545 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-02T23:47:10.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.688+0000 7f045b7a8700 1 Processor -- start 2020-04-02T23:47:10.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.688+0000 7f045b7a8700 1 -- start start 2020-04-02T23:47:10.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f045b7a8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04540a2ab0 0x7f04540aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.698 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f045b7a8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540a5820 con 0x7f0454136870 2020-04-02T23:47:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f045b7a8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540a4130 con 0x7f04540a4b70 2020-04-02T23:47:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f045b7a8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04540a43d0 con 0x7f04540a2ab0 2020-04-02T23:47:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f0458d43700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f04540a4b70 0x7f0454136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54426/0 (socket says 172.21.15.82:54426) 2020-04-02T23:47:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f0458d43700 1 -- 172.21.15.82:0/375017125 learned_addr learned my addr 172.21.15.82:0/375017125 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f0459544700 1 --2- 172.21.15.82:0/375017125 >> v2:172.21.15.50:3300/0 conn(0x7f04540a2ab0 0x7f04540aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979089924 0 0) 0x7f04540a4130 con 0x7f04540a4b70 2020-04-02T23:47:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.689+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f043c003230 con 0x7f04540a4b70 2020-04-02T23:47:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 84475930 0 0) 0x7f043c003230 con 0x7f04540a4b70 2020-04-02T23:47:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 >> v2:172.21.15.50:3300/0 conn(0x7f04540a2ab0 msgr2=0x7f04540aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 --2- 172.21.15.82:0/375017125 >> v2:172.21.15.50:3300/0 conn(0x7f04540a2ab0 0x7f04540aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 >> v1:172.21.15.50:6789/0 conn(0x7f0454136870 legacy=0x7f0454140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540a4670 con 0x7f04540a4b70 2020-04-02T23:47:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f04500016d0 con 0x7f04540a4b70 2020-04-02T23:47:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 >> v1:172.21.15.82:6789/0 conn(0x7f04540a4b70 legacy=0x7f0454136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f043c003720 0x7f043c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043c004db0 0x7f043c00d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540a43d0 con 0x7f043c004db0 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0041c0 con 0x7f043c0044d0 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c00dd90 con 0x7f043c003720 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0459544700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f043c003720 0x7f043c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0459d45700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043c004db0 0x7f043c00d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 -- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f043c003720 msgr2=0x7f043c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f043c003720 0x7f043c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 -- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043c004db0 msgr2=0x7f043c00d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043c004db0 0x7f043c00d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 -- 172.21.15.82:0/375017125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c003230 con 0x7f043c0044d0 2020-04-02T23:47:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0459d45700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043c004db0 0x7f043c00d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0459d45700 1 -- 172.21.15.82:0/375017125 reap_dead start 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).ready entity=mon.1 client_cookie=d84d60241e93a4c4 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045000ce70 con 0x7f043c0044d0 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045000e350 con 0x7f043c0044d0 2020-04-02T23:47:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0458d43700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f045b7a8700 1 -- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 msgr2=0x7f043c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f045b7a8700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).stop 2020-04-02T23:47:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.690+0000 7f0443fff700 1 -- 172.21.15.82:0/375017125 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045000e730 con 0x7f043c0044d0 2020-04-02T23:47:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.691+0000 7f045b7a8700 1 -- 172.21.15.82:0/375017125 shutdown_connections 2020-04-02T23:47:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.691+0000 7f045b7a8700 1 --2- 172.21.15.82:0/375017125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c0044d0 0x7f043c004950 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.691+0000 7f045b7a8700 1 -- 172.21.15.82:0/375017125 >> 172.21.15.82:0/375017125 conn(0x7f045409de60 msgr2=0x7f045409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.691+0000 7f045b7a8700 1 -- 172.21.15.82:0/375017125 shutdown_connections 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.691+0000 7f045b7a8700 1 -- 172.21.15.82:0/375017125 wait complete. 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f045b7a8700 1 Processor -- start 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f045b7a8700 1 -- start start 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f045b7a8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f043c0044d0 0x7f045409ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f045b7a8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f045409f2c0 0x7f0454137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f045b7a8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540673b0 con 0x7f04540a2170 2020-04-02T23:47:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f045b7a8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04540a5680 con 0x7f043c0044d0 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f045b7a8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045409fc90 con 0x7f045409f2c0 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f0458d43700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f045409f2c0 0x7f0454137d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f0458d43700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f045409f2c0 0x7f0454137d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54388/0 (socket says 172.21.15.82:54388) 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f0459d45700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f04540a2170 0x7f0454138170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54440/0 (socket says 172.21.15.82:54440) 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f0458d43700 1 -- 172.21.15.82:0/17666980 learned_addr learned my addr 172.21.15.82:0/17666980 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.692+0000 7f0459544700 1 --2- 172.21.15.82:0/17666980 >> v2:172.21.15.50:3300/0 conn(0x7f043c0044d0 0x7f045409ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 -- 172.21.15.82:0/17666980 >> v2:172.21.15.50:3300/0 conn(0x7f043c0044d0 msgr2=0x7f045409ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> v2:172.21.15.50:3300/0 conn(0x7f043c0044d0 0x7f045409ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390303918 0 0) 0x7f04540673b0 con 0x7f04540a2170 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 -- 172.21.15.82:0/17666980 >> v1:172.21.15.82:6789/0 conn(0x7f04540a2170 legacy=0x7f0454138170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 -- 172.21.15.82:0/17666980 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045409ffd0 con 0x7f045409f2c0 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> v2:172.21.15.82:3300/0 conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> v2:172.21.15.82:3300/0 conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045000e740 con 0x7f045409f2c0 2020-04-02T23:47:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0450001790 con 0x7f045409f2c0 2020-04-02T23:47:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04540a0270 con 0x7f045409f2c0 2020-04-02T23:47:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0450000e90 con 0x7f045409f2c0 2020-04-02T23:47:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0454139130 con 0x7f045409f2c0 2020-04-02T23:47:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.693+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04540a0470 con 0x7f045409f2c0 2020-04-02T23:47:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f04500106a0 con 0x7f045409f2c0 2020-04-02T23:47:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f0458d43700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f04427fc700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f043404d4a0 0x7f043404f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f04500614c0 con 0x7f045409f2c0 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f0459544700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f043404d4a0 0x7f043404f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f04427fc700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] conn(0x7f04340544d0 0x7f04340568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 --> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0434056eb0 con 0x7f04340544d0 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04500629e0 con 0x7f045409f2c0 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f0459544700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f043404d4a0 0x7f043404f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0444002f30 tx=0x7f044400ca00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f0459544700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f043404d4a0 0x7f043404f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0444002f30 tx=0x7f044400ca00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.694+0000 7f0459544700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f043404d4a0 0x7f043404f960 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f0444002f30 tx=0x7f044400ca00).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.695+0000 7f0459d45700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] conn(0x7f04340544d0 0x7f04340568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.695+0000 7f0459d45700 1 -- 172.21.15.82:0/17666980 >> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] conn(0x7f04340544d0 msgr2=0x7f04340568f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-04-02T23:47:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.695+0000 7f0459d45700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] conn(0x7f04340544d0 0x7f04340568f0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.696+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== osd.7 v2:172.21.15.50:6824/24325 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f0434056eb0 con 0x7f04340544d0 2020-04-02T23:47:10.716 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.713+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 --> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0454056c50 con 0x7f04340544d0 2020-04-02T23:47:10.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.713+0000 7f04427fc700 1 -- 172.21.15.82:0/17666980 <== osd.7 v2:172.21.15.50:6824/24325 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0454056c50 con 0x7f04340544d0 2020-04-02T23:47:10.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 >> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] conn(0x7f04340544d0 msgr2=0x7f04340568f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.50:6824/24325,v1:172.21.15.50:6825/24325] conn(0x7f04340544d0 0x7f04340568f0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f043404d4a0 msgr2=0x7f043404f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.717 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f043404d4a0 0x7f043404f960 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f0444002f30 tx=0x7f044400ca00).stop 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 msgr2=0x7f0454137d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f043c0054a0 tx=0x7f04540a2e90).stop 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f0459d45700 1 -- 172.21.15.82:0/17666980 reap_dead start 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 shutdown_connections 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 --2- 172.21.15.82:0/17666980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045409f2c0 0x7f0454137d10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 >> 172.21.15.82:0/17666980 conn(0x7f045409de60 msgr2=0x7f0454068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 shutdown_connections 2020-04-02T23:47:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.714+0000 7f045b7a8700 1 -- 172.21.15.82:0/17666980 wait complete. 2020-04-02T23:47:10.726 INFO:teuthology.orchestra.run.smithi082.stdout:60129542149 2020-04-02T23:47:10.727 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:10.740 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-02T23:47:10.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.882+0000 7fe9ff56c700 1 Processor -- start 2020-04-02T23:47:10.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.882+0000 7fe9ff56c700 1 -- start start 2020-04-02T23:47:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9ff56c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f80a2ab0 0x7fe9f80aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9ff56c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9f8136870 0x7fe9f80a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9ff56c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80a5820 con 0x7fe9f80a4b70 2020-04-02T23:47:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9ff56c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80a4130 con 0x7fe9f8136870 2020-04-02T23:47:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9ff56c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80a43d0 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fdb09700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9f8136870 0x7fe9f80a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fcb07700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe9f80a4b70 0x7fe9f8136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54446/0 (socket says 172.21.15.82:54446) 2020-04-02T23:47:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fdb09700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9f8136870 0x7fe9f80a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54396/0 (socket says 172.21.15.82:54396) 2020-04-02T23:47:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fcb07700 1 -- 172.21.15.82:0/2209140706 learned_addr learned my addr 172.21.15.82:0/2209140706 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fd308700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f80a2ab0 0x7fe9f80aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fdb09700 1 -- 172.21.15.82:0/2209140706 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f80a2ab0 msgr2=0x7fe9f80aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fdb09700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f80a2ab0 0x7fe9f80aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fdb09700 1 -- 172.21.15.82:0/2209140706 >> v1:172.21.15.82:6789/0 conn(0x7fe9f80a4b70 legacy=0x7fe9f8136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fdb09700 1 -- 172.21.15.82:0/2209140706 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80a4670 con 0x7fe9f8136870 2020-04-02T23:47:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9e7fff700 1 -- 172.21.15.82:0/2209140706 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596275728 0 0) 0x7fe9f80a5820 con 0x7fe9f80a4b70 2020-04-02T23:47:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.883+0000 7fe9fdb09700 1 --2- 172.21.15.82:0/2209140706 >> v2:172.21.15.82:3300/0 conn(0x7fe9f8136870 0x7fe9f80a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9f00032b0 tx=0x7fe9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9fdb09700 1 --2- 172.21.15.82:0/2209140706 >> v2:172.21.15.82:3300/0 conn(0x7fe9f8136870 0x7fe9f80a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9f00032b0 tx=0x7fe9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9fdb09700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f8136870 0x7fe9f80a4ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fe9f00032b0 tx=0x7fe9f0007dc0).ready entity=mon.1 client_cookie=a271480a6c9ea4b4 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9fdb09700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f8136870 0x7fe9f80a4ff0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fe9f00032b0 tx=0x7fe9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9e7fff700 1 -- 172.21.15.82:0/2209140706 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f000a160 con 0x7fe9f8136870 2020-04-02T23:47:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9fdb09700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f8136870 0x7fe9f80a4ff0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fe9f00032b0 tx=0x7fe9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9fdb09700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f8136870 0x7fe9f80a4ff0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fe9f00032b0 tx=0x7fe9f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9e7fff700 1 -- 172.21.15.82:0/2209140706 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f000a2c0 con 0x7fe9f8136870 2020-04-02T23:47:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9e7fff700 1 -- 172.21.15.82:0/2209140706 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f000a6a0 con 0x7fe9f8136870 2020-04-02T23:47:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 -- 172.21.15.82:0/2209140706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f8136870 msgr2=0x7fe9f80a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f8136870 0x7fe9f80a4ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fe9f00032b0 tx=0x7fe9f0007dc0).stop 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 -- 172.21.15.82:0/2209140706 shutdown_connections 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f8136870 0x7fe9f80a4ff0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/2209140706 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9f80a2ab0 0x7fe9f80aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 -- 172.21.15.82:0/2209140706 >> 172.21.15.82:0/2209140706 conn(0x7fe9f809de60 msgr2=0x7fe9f809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 -- 172.21.15.82:0/2209140706 shutdown_connections 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.884+0000 7fe9ff56c700 1 -- 172.21.15.82:0/2209140706 wait complete. 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.885+0000 7fe9ff56c700 1 Processor -- start 2020-04-02T23:47:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.885+0000 7fe9ff56c700 1 -- start start 2020-04-02T23:47:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9ff56c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9f80a2ab0 0x7fe9f80625d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9ff56c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9f80a4b70 0x7fe9f8061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9ff56c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f8066540 con 0x7fe9f8136870 2020-04-02T23:47:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9ff56c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f8066ef0 con 0x7fe9f80a4b70 2020-04-02T23:47:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9ff56c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f8062b50 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9f80a2ab0 0x7fe9f80625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fdb09700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe9f8136870 0x7fe9f80a04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54452/0 (socket says 172.21.15.82:54452) 2020-04-02T23:47:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fdb09700 1 -- 172.21.15.82:0/3429989539 learned_addr learned my addr 172.21.15.82:0/3429989539 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fdb09700 1 -- 172.21.15.82:0/3429989539 >> v1:172.21.15.82:6789/0 conn(0x7fe9f8136870 legacy=0x7fe9f80a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-04-02T23:47:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fdb09700 1 -- 172.21.15.82:0/3429989539 >> v1:172.21.15.82:6789/0 conn(0x7fe9f8136870 legacy=0x7fe9f80a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-04-02T23:47:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fdb09700 1 --1- 172.21.15.82:0/3429989539 >> v1:172.21.15.82:6789/0 conn(0x7fe9f8136870 0x7fe9f80a04a0 :-1 s=OPENED pgs=172 cs=1 l=1).handle_message read tag failed 2020-04-02T23:47:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fdb09700 1 --1- 172.21.15.82:0/3429989539 >> v1:172.21.15.82:6789/0 conn(0x7fe9f8136870 0x7fe9f80a04a0 :-1 s=OPENED pgs=172 cs=1 l=1).fault on lossy channel, failing 2020-04-02T23:47:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fcb07700 1 --2- 172.21.15.82:0/3429989539 >> v2:172.21.15.50:3300/0 conn(0x7fe9f80a4b70 0x7fe9f8061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 -- 172.21.15.82:0/3429989539 >> v2:172.21.15.50:3300/0 conn(0x7fe9f80a4b70 msgr2=0x7fe9f8061650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> v2:172.21.15.50:3300/0 conn(0x7fe9f80a4b70 0x7fe9f8061650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 -- 172.21.15.82:0/3429989539 >> v1:172.21.15.82:6789/0 conn(0x7fe9f8136870 legacy=0x7fe9f80a04a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-04-02T23:47:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 -- 172.21.15.82:0/3429989539 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8064300 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> v2:172.21.15.82:3300/0 conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> v2:172.21.15.82:3300/0 conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9e67fc700 1 -- 172.21.15.82:0/3429989539 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e8005e90 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9e67fc700 1 -- 172.21.15.82:0/3429989539 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8007160 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f80a00d0 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9e67fc700 1 -- 172.21.15.82:0/3429989539 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e8007540 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.886+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f80647a0 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.887+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.887+0000 7fe9e67fc700 1 -- 172.21.15.82:0/3429989539 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe9e800e200 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.887+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.887+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f8062d50 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.887+0000 7fe9e67fc700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 0x7fe9d804f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.888+0000 7fe9e67fc700 1 -- 172.21.15.82:0/3429989539 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe9e8061360 con 0x7fe9f80a2ab0 2020-04-02T23:47:10.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.888+0000 7fe9fcb07700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 0x7fe9d804f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:10.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.888+0000 7fe9fcb07700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 0x7fe9d804f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9f4000b80 tx=0x7fe9f40017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.888+0000 7fe9fcb07700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 0x7fe9d804f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9f4000b80 tx=0x7fe9f40017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.888+0000 7fe9fcb07700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 0x7fe9d804f9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fe9f4000b80 tx=0x7fe9f40017c0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:10.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.891+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:10.904 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:10.891+0000 7fe9e67fc700 1 -- 172.21.15.82:0/3429989539 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe9e803cdd0 con 0x7fe9f80a2ab0 2020-04-02T23:47:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.028+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe9f8056c50 con 0x7fe9f80a2ab0 2020-04-02T23:47:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.028+0000 7fe9fd308700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.028+0000 7fe9e67fc700 1 -- 172.21.15.82:0/3429989539 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9e800a0d0 con 0x7fe9f80a2ab0 2020-04-02T23:47:11.031 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 msgr2=0x7fe9d804f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 0x7fe9d804f9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fe9f4000b80 tx=0x7fe9f40017c0).stop 2020-04-02T23:47:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 msgr2=0x7fe9f80625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fe9f8063f10 tx=0x7fe9e8010ba0).stop 2020-04-02T23:47:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 shutdown_connections 2020-04-02T23:47:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9d804d500 0x7fe9d804f9c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/3429989539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9f80a2ab0 0x7fe9f80625d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 --2- 172.21.15.82:0/3429989539 >> v2:172.21.15.50:3300/0 conn(0x7fe9f80a4b70 0x7fe9f8061650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 >> 172.21.15.82:0/3429989539 conn(0x7fe9f809de60 msgr2=0x7fe9f8068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 shutdown_connections 2020-04-02T23:47:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.029+0000 7fe9ff56c700 1 -- 172.21.15.82:0/3429989539 wait complete. 2020-04-02T23:47:11.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2020-04-02T23:47:11.042 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:11.056 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-02T23:47:11.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.199+0000 7fccb8fd0700 1 Processor -- start 2020-04-02T23:47:11.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.199+0000 7fccb8fd0700 1 -- start start 2020-04-02T23:47:11.208 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb8fd0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb40a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb8fd0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fccb40a4ea0 0x7fccb41360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb8fd0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb40a3d50 con 0x7fccb4136530 2020-04-02T23:47:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb8fd0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb40a4110 con 0x7fccb40a4ea0 2020-04-02T23:47:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb8fd0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb4066bf0 con 0x7fccb40a29a0 2020-04-02T23:47:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb40a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb40a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54408/0 (socket says 172.21.15.82:54408) 2020-04-02T23:47:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.200+0000 7fccb259c700 1 -- 172.21.15.82:0/2119328290 learned_addr learned my addr 172.21.15.82:0/2119328290 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb1d9b700 1 --2- 172.21.15.82:0/2119328290 >> v2:172.21.15.50:3300/0 conn(0x7fccb40a4ea0 0x7fccb41360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 -- 172.21.15.82:0/2119328290 >> v2:172.21.15.50:3300/0 conn(0x7fccb40a4ea0 msgr2=0x7fccb41360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 --2- 172.21.15.82:0/2119328290 >> v2:172.21.15.50:3300/0 conn(0x7fccb40a4ea0 0x7fccb41360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 -- 172.21.15.82:0/2119328290 >> v1:172.21.15.50:6789/0 conn(0x7fccb4136530 legacy=0x7fccb4138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 -- 172.21.15.82:0/2119328290 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb40a4300 con 0x7fccb40a29a0 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb1d9b700 1 --2- 172.21.15.82:0/2119328290 >> v2:172.21.15.50:3300/0 conn(0x7fccb40a4ea0 0x7fccb41360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 --2- 172.21.15.82:0/2119328290 >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb40a4a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 --2- 172.21.15.82:0/2119328290 >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb40a4a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 --2- 172.21.15.82:0/2119328290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb40a4a40 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).ready entity=mon.1 client_cookie=9cc1c7ea7953359f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 --2- 172.21.15.82:0/2119328290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb40a4a40 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb159a700 1 -- 172.21.15.82:0/2119328290 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca8011720 con 0x7fccb40a29a0 2020-04-02T23:47:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 --2- 172.21.15.82:0/2119328290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb40a4a40 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb259c700 1 --2- 172.21.15.82:0/2119328290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb40a4a40 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb159a700 1 -- 172.21.15.82:0/2119328290 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca8011880 con 0x7fccb40a29a0 2020-04-02T23:47:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb159a700 1 -- 172.21.15.82:0/2119328290 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca8011c60 con 0x7fccb40a29a0 2020-04-02T23:47:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb8fd0700 1 -- 172.21.15.82:0/2119328290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 msgr2=0x7fccb40a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.201+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/2119328290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb40a4a40 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).stop 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 -- 172.21.15.82:0/2119328290 shutdown_connections 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/2119328290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb40a4a40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/2119328290 >> v2:172.21.15.50:3300/0 conn(0x7fccb40a4ea0 0x7fccb41360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 -- 172.21.15.82:0/2119328290 >> 172.21.15.82:0/2119328290 conn(0x7fccb409de60 msgr2=0x7fccb409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 -- 172.21.15.82:0/2119328290 shutdown_connections 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 -- 172.21.15.82:0/2119328290 wait complete. 2020-04-02T23:47:11.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 Processor -- start 2020-04-02T23:47:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.202+0000 7fccb8fd0700 1 -- start start 2020-04-02T23:47:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb8fd0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb4065a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb8fd0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccb40a4ea0 0x7fccb4065e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb8fd0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb41137b0 con 0x7fccb4136530 2020-04-02T23:47:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb8fd0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb4113a10 con 0x7fccb40a29a0 2020-04-02T23:47:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb8fd0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4113cb0 con 0x7fccb40a4ea0 2020-04-02T23:47:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb4065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb4065a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54412/0 (socket says 172.21.15.82:54412) 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb2d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fccb4136530 0x7fccb4146b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54466/0 (socket says 172.21.15.82:54466) 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 -- 172.21.15.82:0/146928652 learned_addr learned my addr 172.21.15.82:0/146928652 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb1d9b700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccb40a4ea0 0x7fccb4065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 -- 172.21.15.82:0/146928652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccb40a4ea0 msgr2=0x7fccb4065e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccb40a4ea0 0x7fccb4065e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 -- 172.21.15.82:0/146928652 >> v1:172.21.15.82:6789/0 conn(0x7fccb4136530 legacy=0x7fccb4146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693747190 0 0) 0x7fccb41137b0 con 0x7fccb4136530 2020-04-02T23:47:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 -- 172.21.15.82:0/146928652 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb405b9d0 con 0x7fccb40a29a0 2020-04-02T23:47:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.203+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> v2:172.21.15.82:3300/0 conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca8007340 con 0x7fccb40a29a0 2020-04-02T23:47:11.217 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.217 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca80074a0 con 0x7fccb40a29a0 2020-04-02T23:47:11.217 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.217 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb405b390 con 0x7fccb40a29a0 2020-04-02T23:47:11.217 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca80058b0 con 0x7fccb40a29a0 2020-04-02T23:47:11.217 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb4147480 con 0x7fccb40a29a0 2020-04-02T23:47:11.217 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.204+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fcca8005ab0 con 0x7fccb40a29a0 2020-04-02T23:47:11.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb4146970 con 0x7fccb40a29a0 2020-04-02T23:47:11.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fcca37fe700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 0x7fcc9004f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcca80614d0 con 0x7fccb40a29a0 2020-04-02T23:47:11.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fccb1d9b700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 0x7fcc9004f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fccb1d9b700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 0x7fcc9004f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcca4002f30 tx=0x7fcca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fccb1d9b700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 0x7fcc9004f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcca4002f30 tx=0x7fcca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.205+0000 7fccb1d9b700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 0x7fcc9004f920 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fcca4002f30 tx=0x7fcca4007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.208+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.208+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fcca803ccd0 con 0x7fccb40a29a0 2020-04-02T23:47:11.347 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.344+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fccb4113df0 con 0x7fccb40a29a0 2020-04-02T23:47:11.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.345+0000 7fccb259c700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.345+0000 7fcca37fe700 1 -- 172.21.15.82:0/146928652 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcca80402f0 con 0x7fccb40a29a0 2020-04-02T23:47:11.348 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:11.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 msgr2=0x7fcc9004f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 0x7fcc9004f920 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fcca4002f30 tx=0x7fcca4007a40).stop 2020-04-02T23:47:11.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 msgr2=0x7fccb4065a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fcca8002f30 tx=0x7fcca8007a40).stop 2020-04-02T23:47:11.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 shutdown_connections 2020-04-02T23:47:11.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcc9004d460 0x7fcc9004f920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb40a29a0 0x7fccb4065a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 --2- 172.21.15.82:0/146928652 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccb40a4ea0 0x7fccb4065e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 >> 172.21.15.82:0/146928652 conn(0x7fccb409de60 msgr2=0x7fccb40a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:11.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 shutdown_connections 2020-04-02T23:47:11.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.346+0000 7fccb8fd0700 1 -- 172.21.15.82:0/146928652 wait complete. 2020-04-02T23:47:11.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2020-04-02T23:47:11.359 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:11.372 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-02T23:47:11.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.515+0000 7fc804ab3700 1 Processor -- start 2020-04-02T23:47:11.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.515+0000 7fc804ab3700 1 -- start start 2020-04-02T23:47:11.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc804ab3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8000a2ab0 0x7fc8000aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc804ab3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 0x7fc8000a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc804ab3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8000a5820 con 0x7fc8000a4b70 2020-04-02T23:47:11.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc804ab3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8000a4130 con 0x7fc8000a2ab0 2020-04-02T23:47:11.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc804ab3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000a43d0 con 0x7fc800136870 2020-04-02T23:47:11.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fdd9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc8000a4b70 0x7fc800136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54470/0 (socket says 172.21.15.82:54470) 2020-04-02T23:47:11.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fdd9b700 1 -- 172.21.15.82:0/1545008028 learned_addr learned my addr 172.21.15.82:0/1545008028 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:11.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fed9d700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 0x7fc8000a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/1545008028 >> v2:172.21.15.50:3300/0 conn(0x7fc8000a2ab0 0x7fc8000aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236264537 0 0) 0x7fc8000a5820 con 0x7fc8000a4b70 2020-04-02T23:47:11.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e0003230 con 0x7fc8000a4b70 2020-04-02T23:47:11.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 44939929 0 0) 0x7fc7e0003230 con 0x7fc8000a4b70 2020-04-02T23:47:11.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 msgr2=0x7fc8000a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:11.530 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 0x7fc8000a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.530 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 >> v2:172.21.15.50:3300/0 conn(0x7fc8000a2ab0 msgr2=0x7fc8000aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:11.530 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 --2- 172.21.15.82:0/1545008028 >> v2:172.21.15.50:3300/0 conn(0x7fc8000a2ab0 0x7fc8000aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.530 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8000a4670 con 0x7fc8000a4b70 2020-04-02T23:47:11.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fc7e80016d0 con 0x7fc8000a4b70 2020-04-02T23:47:11.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 >> v1:172.21.15.82:6789/0 conn(0x7fc8000a4b70 legacy=0x7fc800136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 0x7fc7e0003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e00045c0 0x7fc7e0004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000a4130 con 0x7fc7e00045c0 2020-04-02T23:47:11.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000a43d0 con 0x7fc7e0003b80 2020-04-02T23:47:11.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0005050 con 0x7fc800136870 2020-04-02T23:47:11.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.516+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 0x7fc7e0003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fed9d700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e00045c0 0x7fc7e0004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 -- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 msgr2=0x7fc7e0003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:11.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc800136870 0x7fc7e0003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 -- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e00045c0 msgr2=0x7fc7e0004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:11.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e00045c0 0x7fc7e0004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 -- 172.21.15.82:0/1545008028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0003230 con 0x7fc7e0003b80 2020-04-02T23:47:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7e80013e0 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7e80013e0 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fc7e80013e0 tx=0x7fc8000a2e90).ready entity=mon.1 client_cookie=c8f2f98a6bf16026 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fc7e80013e0 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e800ce70 con 0x7fc7e0003b80 2020-04-02T23:47:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fc7e80013e0 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fc7e80013e0 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800e350 con 0x7fc7e0003b80 2020-04-02T23:47:11.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fd59a700 1 -- 172.21.15.82:0/1545008028 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e800e730 con 0x7fc7e0003b80 2020-04-02T23:47:11.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc804ab3700 1 -- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 msgr2=0x7fc7e0003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc804ab3700 1 --2- 172.21.15.82:0/1545008028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e0003b80 0x7fc7e0003fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fc7e80013e0 tx=0x7fc8000a2e90).stop 2020-04-02T23:47:11.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc7fed9d700 1 -- 172.21.15.82:0/1545008028 reap_dead start 2020-04-02T23:47:11.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc804ab3700 1 -- 172.21.15.82:0/1545008028 shutdown_connections 2020-04-02T23:47:11.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc804ab3700 1 -- 172.21.15.82:0/1545008028 >> 172.21.15.82:0/1545008028 conn(0x7fc80009de60 msgr2=0x7fc80009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc804ab3700 1 -- 172.21.15.82:0/1545008028 shutdown_connections 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.517+0000 7fc804ab3700 1 -- 172.21.15.82:0/1545008028 wait complete. 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.518+0000 7fc804ab3700 1 Processor -- start 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.518+0000 7fc804ab3700 1 -- start start 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc804ab3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8000a1080 0x7fc800063b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc804ab3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc800148d30 con 0x7fc800063f60 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc804ab3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc800066500 con 0x7fc800062890 2020-04-02T23:47:11.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc804ab3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc800063420 con 0x7fc8000a1080 2020-04-02T23:47:11.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7fed9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc800062890 0x7fc800062d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54486/0 (socket says 172.21.15.82:54486) 2020-04-02T23:47:11.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7fed9d700 1 -- 172.21.15.82:0/2421959403 learned_addr learned my addr 172.21.15.82:0/2421959403 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:11.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8000a1080 0x7fc800063b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073059143 0 0) 0x7fc800066500 con 0x7fc800062890 2020-04-02T23:47:11.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e4002fe0 con 0x7fc800062890 2020-04-02T23:47:11.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704194525 0 0) 0x7fc800148d30 con 0x7fc800063f60 2020-04-02T23:47:11.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc800066500 con 0x7fc800063f60 2020-04-02T23:47:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3303734940 0 0) 0x7fc7e4002fe0 con 0x7fc800062890 2020-04-02T23:47:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc800148d30 con 0x7fc800062890 2020-04-02T23:47:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fc7f0007740 con 0x7fc800062890 2020-04-02T23:47:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8000a1080 msgr2=0x7fc800063b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8000a1080 0x7fc800063b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 >> v1:172.21.15.82:6789/0 conn(0x7fc800062890 legacy=0x7fc800062d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 >> v1:172.21.15.50:6789/0 conn(0x7fc800063f60 legacy=0x7fc800065b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.519+0000 7fc7f77fe700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4004b20 0x7fc7e4004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7e4004370 0x7fc7e400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4004820 con 0x7fc7e4004b20 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e400bbb0 con 0x7fc7e4003ab0 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e400bcf0 con 0x7fc7e4004370 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8000a1080 0x7fc800063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fed9d700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7e4004370 0x7fc7e400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4004b20 0x7fc7e4004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 -- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7e4004370 msgr2=0x7fc7e400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7e4004370 0x7fc7e400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 -- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4004b20 msgr2=0x7fc7e4004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4004b20 0x7fc7e4004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8000667a0 con 0x7fc7e4003ab0 2020-04-02T23:47:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc800066240 con 0x7fc7e4003ab0 2020-04-02T23:47:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4004b20 0x7fc7e4004f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8000a1700 con 0x7fc7e4003ab0 2020-04-02T23:47:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e80045b0 con 0x7fc7e4003ab0 2020-04-02T23:47:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e8004710 con 0x7fc7e4003ab0 2020-04-02T23:47:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.520+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e8004b30 con 0x7fc7e4003ab0 2020-04-02T23:47:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.521+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.521+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc7e8004c90 con 0x7fc7e4003ab0 2020-04-02T23:47:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.521+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.521+0000 7fc7f77fe700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc7e4055ff0 0x7fc7e40584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.521+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc800066930 con 0x7fc7e4003ab0 2020-04-02T23:47:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.521+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc7e80613e0 con 0x7fc7e4003ab0 2020-04-02T23:47:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.521+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc7e4055ff0 0x7fc7e40584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.522+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc7e4055ff0 0x7fc7e40584b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7f80032b0 tx=0x7fc7f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.522+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc7e4055ff0 0x7fc7e40584b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7f80032b0 tx=0x7fc7f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.522+0000 7fc7fe59c700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc7e4055ff0 0x7fc7e40584b0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fc7f80032b0 tx=0x7fc7f8007a80).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.525+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.544 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.525+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc7e803cc00 con 0x7fc7e4003ab0 2020-04-02T23:47:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.663+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc800056c50 con 0x7fc7e4003ab0 2020-04-02T23:47:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.663+0000 7fc7fdd9b700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.663+0000 7fc7f77fe700 1 -- 172.21.15.82:0/2421959403 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7e8040220 con 0x7fc7e4003ab0 2020-04-02T23:47:11.667 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.664+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc7e4055ff0 msgr2=0x7fc7e40584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.668 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.664+0000 7fc804ab3700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc7e4055ff0 0x7fc7e40584b0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fc7f80032b0 tx=0x7fc7f8007a80).stop 2020-04-02T23:47:11.668 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.664+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 msgr2=0x7fc7e4003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.668 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.664+0000 7fc804ab3700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fc7e800bb30 tx=0x7fc8000a2e90).stop 2020-04-02T23:47:11.668 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.664+0000 7fc7fed9d700 1 -- 172.21.15.82:0/2421959403 reap_dead start 2020-04-02T23:47:11.668 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.665+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 shutdown_connections 2020-04-02T23:47:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.665+0000 7fc804ab3700 1 --2- 172.21.15.82:0/2421959403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4003ab0 0x7fc7e4003f10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.665+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 >> 172.21.15.82:0/2421959403 conn(0x7fc80009de60 msgr2=0x7fc800068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.665+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 shutdown_connections 2020-04-02T23:47:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.665+0000 7fc804ab3700 1 -- 172.21.15.82:0/2421959403 wait complete. 2020-04-02T23:47:11.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2020-04-02T23:47:11.678 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:11.691 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-02T23:47:11.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.833+0000 7f10272b8700 1 Processor -- start 2020-04-02T23:47:11.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.834+0000 7f10272b8700 1 -- start start 2020-04-02T23:47:11.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.834+0000 7f10272b8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.834+0000 7f10272b8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1020137950 0x7f1020141370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:11.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.834+0000 7f10272b8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10200a2200 con 0x7f102013a490 2020-04-02T23:47:11.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.834+0000 7f10272b8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10200a6650 con 0x7f1020137950 2020-04-02T23:47:11.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.834+0000 7f10272b8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10200a7250 con 0x7f10200a49a0 2020-04-02T23:47:11.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025855700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1020137950 0x7f1020141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025855700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1020137950 0x7f1020141370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:51032/0 (socket says 172.21.15.82:51032) 2020-04-02T23:47:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1024853700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f102013a490 0x7f1020137240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58466/0 (socket says 172.21.15.82:58466) 2020-04-02T23:47:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025855700 1 -- 172.21.15.82:0/305994461 learned_addr learned my addr 172.21.15.82:0/305994461 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:50152/0 (socket says 172.21.15.82:50152) 2020-04-02T23:47:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 -- 172.21.15.82:0/305994461 >> v2:172.21.15.50:3300/0 conn(0x7f1020137950 msgr2=0x7f1020141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- 172.21.15.82:0/305994461 >> v2:172.21.15.50:3300/0 conn(0x7f1020137950 0x7f1020141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 -- 172.21.15.82:0/305994461 >> v1:172.21.15.50:6789/0 conn(0x7f102013a490 legacy=0x7f1020137240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 -- 172.21.15.82:0/305994461 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020066d20 con 0x7f10200a49a0 2020-04-02T23:47:11.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1010002f30 tx=0x7f1010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1010002f30 tx=0x7f1010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1010002f30 tx=0x7f1010007a40).ready entity=mon.2 client_cookie=d584207e54d58b92 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1010002f30 tx=0x7f1010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f100ffff700 1 -- 172.21.15.82:0/305994461 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10100113c0 con 0x7f10200a49a0 2020-04-02T23:47:11.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1010002f30 tx=0x7f1010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f1025054700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1010002f30 tx=0x7f1010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f100ffff700 1 -- 172.21.15.82:0/305994461 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1010011520 con 0x7f10200a49a0 2020-04-02T23:47:11.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f100ffff700 1 -- 172.21.15.82:0/305994461 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1010011940 con 0x7f10200a49a0 2020-04-02T23:47:11.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f10272b8700 1 -- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 msgr2=0x7f102013a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.835+0000 7f10272b8700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1010002f30 tx=0x7f1010007a40).stop 2020-04-02T23:47:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.836+0000 7f10272b8700 1 -- 172.21.15.82:0/305994461 shutdown_connections 2020-04-02T23:47:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.836+0000 7f10272b8700 1 --2- 172.21.15.82:0/305994461 >> v2:172.21.15.50:3300/0 conn(0x7f1020137950 0x7f1020141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.836+0000 7f10272b8700 1 --2- 172.21.15.82:0/305994461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10200a49a0 0x7f102013a030 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.836+0000 7f10272b8700 1 -- 172.21.15.82:0/305994461 >> 172.21.15.82:0/305994461 conn(0x7f102009de60 msgr2=0x7f102009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.836+0000 7f10272b8700 1 -- 172.21.15.82:0/305994461 shutdown_connections 2020-04-02T23:47:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.836+0000 7f10272b8700 1 -- 172.21.15.82:0/305994461 wait complete. 2020-04-02T23:47:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f10272b8700 1 Processor -- start 2020-04-02T23:47:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f10272b8700 1 -- start start 2020-04-02T23:47:11.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f10272b8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1020131180 0x7f1020131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f10272b8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10200a16a0 con 0x7f10200a49a0 2020-04-02T23:47:11.849 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f10272b8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1020139300 con 0x7f1020137950 2020-04-02T23:47:11.849 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f10272b8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10201395a0 con 0x7f1020131180 2020-04-02T23:47:11.850 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f1024853700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1020137950 0x7f1020147c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54504/0 (socket says 172.21.15.82:54504) 2020-04-02T23:47:11.850 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f1024853700 1 -- 172.21.15.82:0/3683634586 learned_addr learned my addr 172.21.15.82:0/3683634586 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:11.850 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.837+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> v2:172.21.15.82:3300/0 conn(0x7f1020131180 0x7f1020131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.850 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 -- 172.21.15.82:0/3683634586 >> v1:172.21.15.82:6789/0 conn(0x7f1020137950 legacy=0x7f1020147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.851 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 -- 172.21.15.82:0/3683634586 >> v1:172.21.15.50:6789/0 conn(0x7f10200a49a0 legacy=0x7f10200a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.851 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214478116 0 0) 0x7f1020139300 con 0x7f1020137950 2020-04-02T23:47:11.851 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 -- 172.21.15.82:0/3683634586 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020139840 con 0x7f1020131180 2020-04-02T23:47:11.851 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> v2:172.21.15.82:3300/0 conn(0x7f1020131180 0x7f1020131630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.851 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> v2:172.21.15.82:3300/0 conn(0x7f1020131180 0x7f1020131630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.851 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.851 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.852 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101800e350 con 0x7f1020131180 2020-04-02T23:47:11.852 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.852 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.852 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018005c30 con 0x7f1020131180 2020-04-02T23:47:11.853 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10200aaba0 con 0x7f1020131180 2020-04-02T23:47:11.853 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101800c900 con 0x7f1020131180 2020-04-02T23:47:11.853 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.838+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1020131a90 con 0x7f1020131180 2020-04-02T23:47:11.853 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.839+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.853 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.839+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f101800cb00 con 0x7f1020131180 2020-04-02T23:47:11.854 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.839+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.854 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.839+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1020139c00 con 0x7f1020131180 2020-04-02T23:47:11.854 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.840+0000 7f100e7fc700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 0x7f100004f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:11.857 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.840+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1018060e40 con 0x7f1020131180 2020-04-02T23:47:11.857 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.840+0000 7f1025054700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 0x7f100004f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:11.857 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.840+0000 7f1025054700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 0x7f100004f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10100088e0 tx=0x7f1010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.857 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.840+0000 7f1025054700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 0x7f100004f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10100088e0 tx=0x7f1010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.840+0000 7f1025054700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 0x7f100004f8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f10100088e0 tx=0x7f1010007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.843+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.860 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.843+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f101803c4c0 con 0x7f1020131180 2020-04-02T23:47:11.983 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.980+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1020139140 con 0x7f1020131180 2020-04-02T23:47:11.984 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.981+0000 7f1025855700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:11.984 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.981+0000 7f100e7fc700 1 -- 172.21.15.82:0/3683634586 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f101803fae0 con 0x7f1020131180 2020-04-02T23:47:11.984 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:11.985 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 msgr2=0x7f100004f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.985 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 0x7f100004f8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f10100088e0 tx=0x7f1010007a40).stop 2020-04-02T23:47:11.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 msgr2=0x7f1020131630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:11.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f1010007ed0 tx=0x7f1018010f70).stop 2020-04-02T23:47:11.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 shutdown_connections 2020-04-02T23:47:11.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1020131180 0x7f1020131630 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 --2- 172.21.15.82:0/3683634586 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f100004d420 0x7f100004f8e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:11.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 >> 172.21.15.82:0/3683634586 conn(0x7f102009de60 msgr2=0x7f10200a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:11.986 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 shutdown_connections 2020-04-02T23:47:11.987 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:11.982+0000 7f10272b8700 1 -- 172.21.15.82:0/3683634586 wait complete. 2020-04-02T23:47:11.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2020-04-02T23:47:11.995 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:12.009 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-02T23:47:12.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.153+0000 7fcad3cea700 1 Processor -- start 2020-04-02T23:47:12.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.153+0000 7fcad3cea700 1 -- start start 2020-04-02T23:47:12.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.153+0000 7fcad3cea700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 0x7fcacc066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:12.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad3cea700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc0675c0 con 0x7fcacc0aaf20 2020-04-02T23:47:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad3cea700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc0abc50 con 0x7fcacc09e7d0 2020-04-02T23:47:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad3cea700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc13d100 con 0x7fcacc09e3f0 2020-04-02T23:47:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad1285700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcacc09e7d0 0x7fcacc13c9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54510/0 (socket says 172.21.15.82:54510) 2020-04-02T23:47:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad1285700 1 -- 172.21.15.82:0/3964139471 learned_addr learned my addr 172.21.15.82:0/3964139471 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad1a86700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 0x7fcacc066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519097515 0 0) 0x7fcac00010d0 con 0x7fcacc09e7d0 2020-04-02T23:47:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab4003230 con 0x7fcacc09e7d0 2020-04-02T23:47:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005014701 0 0) 0x7fcacc0675c0 con 0x7fcacc0aaf20 2020-04-02T23:47:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac00010d0 con 0x7fcacc0aaf20 2020-04-02T23:47:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1780677327 0 0) 0x7fcab4003230 con 0x7fcacc09e7d0 2020-04-02T23:47:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 msgr2=0x7fcacc066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 0x7fcacc066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 >> v1:172.21.15.50:6789/0 conn(0x7fcacc0aaf20 legacy=0x7fcacc143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc13c2b0 con 0x7fcacc09e7d0 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fcac0001860 con 0x7fcacc09e7d0 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad1a86700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 0x7fcacc066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 >> v1:172.21.15.82:6789/0 conn(0x7fcacc09e7d0 legacy=0x7fcacc13c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 0x7fcab40038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab4003d10 0x7fcab40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc13d100 con 0x7fcab4003d10 2020-04-02T23:47:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4005210 con 0x7fcab4004930 2020-04-02T23:47:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400b720 con 0x7fcacc09e3f0 2020-04-02T23:47:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad1a86700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 0x7fcab40038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.154+0000 7fcad1285700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab4003d10 0x7fcab40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 -- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 msgr2=0x7fcab40038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcacc09e3f0 0x7fcab40038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 -- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab4003d10 msgr2=0x7fcab40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:12.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab4003d10 0x7fcab40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:12.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 -- 172.21.15.82:0/3964139471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4003230 con 0x7fcab4004930 2020-04-02T23:47:12.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcac80010d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcac80010d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fcac80010d0 tx=0x7fcac800beb0).ready entity=mon.1 client_cookie=c44e3c29c769fa58 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fcac80010d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fcac80010d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac8001ac0 con 0x7fcab4004930 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fcac80010d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800c9b0 con 0x7fcab4004930 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad0a84700 1 -- 172.21.15.82:0/3964139471 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac800cdd0 con 0x7fcab4004930 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad3cea700 1 -- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 msgr2=0x7fcab4004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad3cea700 1 --2- 172.21.15.82:0/3964139471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcab4004930 0x7fcab4004db0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fcac80010d0 tx=0x7fcac800beb0).stop 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad2287700 1 -- 172.21.15.82:0/3964139471 reap_dead start 2020-04-02T23:47:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad3cea700 1 -- 172.21.15.82:0/3964139471 shutdown_connections 2020-04-02T23:47:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad3cea700 1 -- 172.21.15.82:0/3964139471 >> 172.21.15.82:0/3964139471 conn(0x7fcacc0abdf0 msgr2=0x7fcacc0ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad3cea700 1 -- 172.21.15.82:0/3964139471 shutdown_connections 2020-04-02T23:47:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.155+0000 7fcad3cea700 1 -- 172.21.15.82:0/3964139471 wait complete. 2020-04-02T23:47:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.156+0000 7fcad3cea700 1 Processor -- start 2020-04-02T23:47:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.156+0000 7fcad3cea700 1 -- start start 2020-04-02T23:47:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad3cea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcacc0a8bd0 0x7fcacc134fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad3cea700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcacc136f10 0x7fcacc151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad3cea700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc14a1f0 con 0x7fcacc136ab0 2020-04-02T23:47:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad3cea700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc14a490 con 0x7fcacc0a8bd0 2020-04-02T23:47:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad3cea700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc14a730 con 0x7fcacc136f10 2020-04-02T23:47:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad1285700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcacc136ab0 0x7fcacc137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54524/0 (socket says 172.21.15.82:54524) 2020-04-02T23:47:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcacc136f10 0x7fcacc151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad1285700 1 -- 172.21.15.82:0/1979478114 learned_addr learned my addr 172.21.15.82:0/1979478114 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad1a86700 1 --2- 172.21.15.82:0/1979478114 >> v2:172.21.15.50:3300/0 conn(0x7fcacc0a8bd0 0x7fcacc134fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 -- 172.21.15.82:0/1979478114 >> v2:172.21.15.50:3300/0 conn(0x7fcacc0a8bd0 msgr2=0x7fcacc134fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> v2:172.21.15.50:3300/0 conn(0x7fcacc0a8bd0 0x7fcacc134fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 -- 172.21.15.82:0/1979478114 >> v1:172.21.15.82:6789/0 conn(0x7fcacc136ab0 legacy=0x7fcacc137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 -- 172.21.15.82:0/1979478114 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0a9260 con 0x7fcacc136f10 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079066711 0 0) 0x7fcacc14a1f0 con 0x7fcacc136ab0 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> v2:172.21.15.82:3300/0 conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> v2:172.21.15.82:3300/0 conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac80116d0 con 0x7fcacc136f10 2020-04-02T23:47:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8011830 con 0x7fcacc136f10 2020-04-02T23:47:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac8011bd0 con 0x7fcacc136f10 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc149e70 con 0x7fcacc136f10 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.157+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc137c40 con 0x7fcacc136f10 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.158+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.158+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fcac8011d30 con 0x7fcacc136f10 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.158+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.158+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc056c50 con 0x7fcacc136f10 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.159+0000 7fcabeffd700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 0x7fcaac04f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.159+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcac80607f0 con 0x7fcacc136f10 2020-04-02T23:47:12.174 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.159+0000 7fcad1a86700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 0x7fcaac04f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.174 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.159+0000 7fcad1a86700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 0x7fcaac04f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcac40032b0 tx=0x7fcac4007ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.174 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.159+0000 7fcad1a86700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 0x7fcaac04f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcac40032b0 tx=0x7fcac4007ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.174 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.159+0000 7fcad1a86700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 0x7fcaac04f960 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fcac40032b0 tx=0x7fcac4007ca0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.162+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.162+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fcac803c010 con 0x7fcacc136f10 2020-04-02T23:47:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.300+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcacc0a9770 con 0x7fcacc136f10 2020-04-02T23:47:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.301+0000 7fcad2287700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.301+0000 7fcabeffd700 1 -- 172.21.15.82:0/1979478114 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcac803f630 con 0x7fcacc136f10 2020-04-02T23:47:12.305 INFO:teuthology.orchestra.run.smithi082.stdout:60129542151 2020-04-02T23:47:12.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 msgr2=0x7fcaac04f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 0x7fcaac04f960 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fcac40032b0 tx=0x7fcac4007ca0).stop 2020-04-02T23:47:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 msgr2=0x7fcacc151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fcacc13c8d0 tx=0x7fcac800beb0).stop 2020-04-02T23:47:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 shutdown_connections 2020-04-02T23:47:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcacc136f10 0x7fcacc151210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 --2- 172.21.15.82:0/1979478114 >> v2:172.21.15.50:3300/0 conn(0x7fcacc0a8bd0 0x7fcacc134fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 --2- 172.21.15.82:0/1979478114 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcaac04d4a0 0x7fcaac04f960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 >> 172.21.15.82:0/1979478114 conn(0x7fcacc0abdf0 msgr2=0x7fcacc0af310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 shutdown_connections 2020-04-02T23:47:12.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.302+0000 7fcad3cea700 1 -- 172.21.15.82:0/1979478114 wait complete. 2020-04-02T23:47:12.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2020-04-02T23:47:12.317 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:12.330 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-02T23:47:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.473+0000 7f1b55c87700 1 Processor -- start 2020-04-02T23:47:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.473+0000 7f1b55c87700 1 -- start start 2020-04-02T23:47:12.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b55c87700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b50137240 0x7f1b501376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:12.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b55c87700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b500a2200 con 0x7f1b5013f360 2020-04-02T23:47:12.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b55c87700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b50066d20 con 0x7f1b500a49a0 2020-04-02T23:47:12.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b55c87700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5013a740 con 0x7f1b50137240 2020-04-02T23:47:12.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b4effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b50137240 0x7f1b501376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b4f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1b500a49a0 0x7f1b5013a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54530/0 (socket says 172.21.15.82:54530) 2020-04-02T23:47:12.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b4effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b50137240 0x7f1b501376a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54482/0 (socket says 172.21.15.82:54482) 2020-04-02T23:47:12.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.474+0000 7f1b4f7fe700 1 -- 172.21.15.82:0/1019864061 learned_addr learned my addr 172.21.15.82:0/1019864061 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:12.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 -- 172.21.15.82:0/1019864061 >> v1:172.21.15.82:6789/0 conn(0x7f1b500a49a0 legacy=0x7f1b5013a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 -- 172.21.15.82:0/1019864061 >> v1:172.21.15.50:6789/0 conn(0x7f1b5013f360 legacy=0x7f1b50141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:12.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4e7fc700 1 -- 172.21.15.82:0/1019864061 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737659563 0 0) 0x7f1b50066d20 con 0x7f1b500a49a0 2020-04-02T23:47:12.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 -- 172.21.15.82:0/1019864061 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500a1bb0 con 0x7f1b50137240 2020-04-02T23:47:12.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1019864061 >> v2:172.21.15.82:3300/0 conn(0x7f1b50137240 0x7f1b501376a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b5009f190 tx=0x7f1b44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1019864061 >> v2:172.21.15.82:3300/0 conn(0x7f1b50137240 0x7f1b501376a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b5009f190 tx=0x7f1b44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1019864061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50137240 0x7f1b501376a0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).ready entity=mon.1 client_cookie=46c4275154d31f99 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1019864061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50137240 0x7f1b501376a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.495 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4e7fc700 1 -- 172.21.15.82:0/1019864061 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b44011430 con 0x7f1b50137240 2020-04-02T23:47:12.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1019864061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50137240 0x7f1b501376a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4e7fc700 1 -- 172.21.15.82:0/1019864061 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44011590 con 0x7f1b50137240 2020-04-02T23:47:12.496 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1019864061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50137240 0x7f1b501376a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b4e7fc700 1 -- 172.21.15.82:0/1019864061 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b44011970 con 0x7f1b50137240 2020-04-02T23:47:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b55c87700 1 -- 172.21.15.82:0/1019864061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50137240 msgr2=0x7f1b501376a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1019864061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50137240 0x7f1b501376a0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).stop 2020-04-02T23:47:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b55c87700 1 -- 172.21.15.82:0/1019864061 shutdown_connections 2020-04-02T23:47:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1019864061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50137240 0x7f1b501376a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b55c87700 1 -- 172.21.15.82:0/1019864061 >> 172.21.15.82:0/1019864061 conn(0x7f1b5009de60 msgr2=0x7f1b5009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b55c87700 1 -- 172.21.15.82:0/1019864061 shutdown_connections 2020-04-02T23:47:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.475+0000 7f1b55c87700 1 -- 172.21.15.82:0/1019864061 wait complete. 2020-04-02T23:47:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.476+0000 7f1b55c87700 1 Processor -- start 2020-04-02T23:47:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.476+0000 7f1b55c87700 1 -- start start 2020-04-02T23:47:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b55c87700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b500a49a0 0x7f1b50139660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b55c87700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b50137240 0x7f1b50134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b55c87700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b5013f360 0x7f1b5012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b55c87700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b50139b50 con 0x7f1b50137240 2020-04-02T23:47:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b55c87700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b50138f60 con 0x7f1b500a49a0 2020-04-02T23:47:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b55c87700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b501391c0 con 0x7f1b5013f360 2020-04-02T23:47:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b500a49a0 0x7f1b50139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b500a49a0 0x7f1b50139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54486/0 (socket says 172.21.15.82:54486) 2020-04-02T23:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 -- 172.21.15.82:0/1350796014 learned_addr learned my addr 172.21.15.82:0/1350796014 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1350796014 >> v2:172.21.15.50:3300/0 conn(0x7f1b50137240 0x7f1b50134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4ffff700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b5013f360 0x7f1b5012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 -- 172.21.15.82:0/1350796014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b5013f360 msgr2=0x7f1b5012f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b5013f360 0x7f1b5012f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 -- 172.21.15.82:0/1350796014 >> v2:172.21.15.50:3300/0 conn(0x7f1b50137240 msgr2=0x7f1b50134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> v2:172.21.15.50:3300/0 conn(0x7f1b50137240 0x7f1b50134860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 -- 172.21.15.82:0/1350796014 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5013a880 con 0x7f1b500a49a0 2020-04-02T23:47:12.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> v2:172.21.15.82:3300/0 conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> v2:172.21.15.82:3300/0 conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.477+0000 7f1b4cff9700 1 -- 172.21.15.82:0/1350796014 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b40005ca0 con 0x7f1b500a49a0 2020-04-02T23:47:12.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b4cff9700 1 -- 172.21.15.82:0/1350796014 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40005e00 con 0x7f1b500a49a0 2020-04-02T23:47:12.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b50139d80 con 0x7f1b500a49a0 2020-04-02T23:47:12.508 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b4cff9700 1 -- 172.21.15.82:0/1350796014 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b400062b0 con 0x7f1b500a49a0 2020-04-02T23:47:12.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b50066e50 con 0x7f1b500a49a0 2020-04-02T23:47:12.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.478+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b50056c50 con 0x7f1b500a49a0 2020-04-02T23:47:12.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4cff9700 1 -- 172.21.15.82:0/1350796014 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1b40006520 con 0x7f1b500a49a0 2020-04-02T23:47:12.509 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4cff9700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 0x7f1b3004f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4cff9700 1 -- 172.21.15.82:0/1350796014 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1b40061000 con 0x7f1b500a49a0 2020-04-02T23:47:12.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 0x7f1b3004f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.510 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 0x7f1b3004f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 0x7f1b3004f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.479+0000 7f1b4effd700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 0x7f1b3004f9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.511 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.482+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.512 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.482+0000 7f1b4cff9700 1 -- 172.21.15.82:0/1350796014 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1b4003c760 con 0x7f1b500a49a0 2020-04-02T23:47:12.624 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.620+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1b5013f0c0 con 0x7f1b500a49a0 2020-04-02T23:47:12.624 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.621+0000 7f1b4f7fe700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.624 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.621+0000 7f1b4cff9700 1 -- 172.21.15.82:0/1350796014 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b4003fd80 con 0x7f1b500a49a0 2020-04-02T23:47:12.625 INFO:teuthology.orchestra.run.smithi082.stdout:60129542151 2020-04-02T23:47:12.626 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 msgr2=0x7f1b3004f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 0x7f1b3004f9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f1b5009f190 tx=0x7f1b44007a40).stop 2020-04-02T23:47:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 msgr2=0x7f1b50139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f1b40000b80 tx=0x7f1b40010a10).stop 2020-04-02T23:47:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 shutdown_connections 2020-04-02T23:47:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1b3004d500 0x7f1b3004f9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b5013f360 0x7f1b5012f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1350796014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500a49a0 0x7f1b50139660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 --2- 172.21.15.82:0/1350796014 >> v2:172.21.15.50:3300/0 conn(0x7f1b50137240 0x7f1b50134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 >> 172.21.15.82:0/1350796014 conn(0x7f1b5009de60 msgr2=0x7f1b50136250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 shutdown_connections 2020-04-02T23:47:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.622+0000 7f1b55c87700 1 -- 172.21.15.82:0/1350796014 wait complete. 2020-04-02T23:47:12.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2020-04-02T23:47:12.635 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:12.650 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-02T23:47:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9ad114700 1 Processor -- start 2020-04-02T23:47:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9ad114700 1 -- start start 2020-04-02T23:47:12.803 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9ad114700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a80a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:12.804 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9ad114700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9a8138680 0x7ff9a80a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:12.804 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9ad114700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80a77a0 con 0x7ff9a80666c0 2020-04-02T23:47:12.804 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9ad114700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a81395c0 con 0x7ff9a8138680 2020-04-02T23:47:12.804 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9ad114700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8138ae0 con 0x7ff9a80abb00 2020-04-02T23:47:12.804 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9a659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9a8138680 0x7ff9a80a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.804 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.794+0000 7ff9a659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9a8138680 0x7ff9a80a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54494/0 (socket says 172.21.15.82:54494) 2020-04-02T23:47:12.805 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 -- 172.21.15.82:0/2584331054 learned_addr learned my addr 172.21.15.82:0/2584331054 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:12.805 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 -- 172.21.15.82:0/2584331054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 msgr2=0x7ff9a80a3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:12.805 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a80a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.805 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a80a3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 -- 172.21.15.82:0/2584331054 >> v1:172.21.15.50:6789/0 conn(0x7ff9a80666c0 legacy=0x7ff9a8066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 -- 172.21.15.82:0/2584331054 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80a62b0 con 0x7ff9a8138680 2020-04-02T23:47:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 --2- 172.21.15.82:0/2584331054 >> v2:172.21.15.82:3300/0 conn(0x7ff9a8138680 0x7ff9a80a69f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 --2- 172.21.15.82:0/2584331054 >> v2:172.21.15.82:3300/0 conn(0x7ff9a8138680 0x7ff9a80a69f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a8138680 0x7ff9a80a69f0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).ready entity=mon.1 client_cookie=1e8416456994618b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a8138680 0x7ff9a80a69f0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a5d9b700 1 -- 172.21.15.82:0/2584331054 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9980116e0 con 0x7ff9a8138680 2020-04-02T23:47:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a8138680 0x7ff9a80a69f0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a659c700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a8138680 0x7ff9a80a69f0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a5d9b700 1 -- 172.21.15.82:0/2584331054 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998011840 con 0x7ff9a8138680 2020-04-02T23:47:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9a5d9b700 1 -- 172.21.15.82:0/2584331054 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff998011c60 con 0x7ff9a8138680 2020-04-02T23:47:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9ad114700 1 -- 172.21.15.82:0/2584331054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a8138680 msgr2=0x7ff9a80a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.795+0000 7ff9ad114700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a8138680 0x7ff9a80a69f0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).stop 2020-04-02T23:47:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 -- 172.21.15.82:0/2584331054 shutdown_connections 2020-04-02T23:47:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a80a3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 --2- 172.21.15.82:0/2584331054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a8138680 0x7ff9a80a69f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 -- 172.21.15.82:0/2584331054 >> 172.21.15.82:0/2584331054 conn(0x7ff9a809de60 msgr2=0x7ff9a809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 -- 172.21.15.82:0/2584331054 shutdown_connections 2020-04-02T23:47:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 -- 172.21.15.82:0/2584331054 wait complete. 2020-04-02T23:47:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 Processor -- start 2020-04-02T23:47:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.796+0000 7ff9ad114700 1 -- start start 2020-04-02T23:47:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9ad114700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9a80666c0 0x7ff9a812b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9ad114700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a8065d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9ad114700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9a8138680 0x7ff9a8129ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9ad114700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a812c300 con 0x7ff9a8138680 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9ad114700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a812b600 con 0x7ff9a80666c0 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9ad114700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a812b360 con 0x7ff9a80abb00 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9a80666c0 0x7ff9a812b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9a80666c0 0x7ff9a812b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54502/0 (socket says 172.21.15.82:54502) 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 -- 172.21.15.82:0/443564800 learned_addr learned my addr 172.21.15.82:0/443564800 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a659c700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a8065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a759e700 1 --2- 172.21.15.82:0/443564800 >> v2:172.21.15.50:3300/0 conn(0x7ff9a8138680 0x7ff9a8129ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 -- 172.21.15.82:0/443564800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 msgr2=0x7ff9a8065d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a8065d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 -- 172.21.15.82:0/443564800 >> v2:172.21.15.50:3300/0 conn(0x7ff9a8138680 msgr2=0x7ff9a8129ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> v2:172.21.15.50:3300/0 conn(0x7ff9a8138680 0x7ff9a8129ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 -- 172.21.15.82:0/443564800 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8066190 con 0x7ff9a80666c0 2020-04-02T23:47:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.797+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> v2:172.21.15.82:3300/0 conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> v2:172.21.15.82:3300/0 conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff997fff700 1 -- 172.21.15.82:0/443564800 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff99c00a350 con 0x7ff9a80666c0 2020-04-02T23:47:12.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff997fff700 1 -- 172.21.15.82:0/443564800 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c00a4b0 con 0x7ff9a80666c0 2020-04-02T23:47:12.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff997fff700 1 -- 172.21.15.82:0/443564800 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff99c00a8d0 con 0x7ff9a80666c0 2020-04-02T23:47:12.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a8066b10 con 0x7ff9a80666c0 2020-04-02T23:47:12.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a809f250 con 0x7ff9a80666c0 2020-04-02T23:47:12.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.798+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a8056c50 con 0x7ff9a80666c0 2020-04-02T23:47:12.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff997fff700 1 -- 172.21.15.82:0/443564800 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff99c00ab40 con 0x7ff9a80666c0 2020-04-02T23:47:12.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff997fff700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 0x7ff98404fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff997fff700 1 -- 172.21.15.82:0/443564800 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff99c060ae0 con 0x7ff9a80666c0 2020-04-02T23:47:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff9a659c700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 0x7ff98404fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff9a659c700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 0x7ff98404fbb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff9a659c700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 0x7ff98404fbb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.799+0000 7ff9a659c700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 0x7ff98404fbb0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:12.815 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.802+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.815 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.802+0000 7ff997fff700 1 -- 172.21.15.82:0/443564800 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff99c03c240 con 0x7ff9a80666c0 2020-04-02T23:47:12.943 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.940+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff9a805d150 con 0x7ff9a80666c0 2020-04-02T23:47:12.944 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.940+0000 7ff9a6d9d700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:12.944 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.940+0000 7ff997fff700 1 -- 172.21.15.82:0/443564800 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff99c03f860 con 0x7ff9a80666c0 2020-04-02T23:47:12.944 INFO:teuthology.orchestra.run.smithi082.stdout:60129542151 2020-04-02T23:47:12.945 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 msgr2=0x7ff98404fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.945 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 0x7ff98404fbb0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ff9a80a5bd0 tx=0x7ff998007a40).stop 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 msgr2=0x7ff9a812b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff99c002f30 tx=0x7ff99c010a40).stop 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 shutdown_connections 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff98404d6f0 0x7ff98404fbb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 --2- 172.21.15.82:0/443564800 >> v2:172.21.15.50:3300/0 conn(0x7ff9a8138680 0x7ff9a8129ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a80666c0 0x7ff9a812b7f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 --2- 172.21.15.82:0/443564800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9a80abb00 0x7ff9a8065d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.941+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 >> 172.21.15.82:0/443564800 conn(0x7ff9a809de60 msgr2=0x7ff9a80ab050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.942+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 shutdown_connections 2020-04-02T23:47:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:12.942+0000 7ff9ad114700 1 -- 172.21.15.82:0/443564800 wait complete. 2020-04-02T23:47:12.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.6 2020-04-02T23:47:12.954 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:12.968 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-02T23:47:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.110+0000 7f54a7f86700 1 Processor -- start 2020-04-02T23:47:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.110+0000 7f54a7f86700 1 -- start start 2020-04-02T23:47:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a7f86700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a7f86700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00a5820 con 0x7f54a0136870 2020-04-02T23:47:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a7f86700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00a4130 con 0x7f54a00a4b70 2020-04-02T23:47:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a7f86700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00a43d0 con 0x7f54a00a2ab0 2020-04-02T23:47:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a5521700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f54a00a4b70 0x7f54a0136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54558/0 (socket says 172.21.15.82:54558) 2020-04-02T23:47:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a5521700 1 -- 172.21.15.82:0/1535788645 learned_addr learned my addr 172.21.15.82:0/1535788645 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a5d22700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a4d20700 1 -- 172.21.15.82:0/1535788645 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227240700 0 0) 0x7f54a00a4130 con 0x7f54a00a4b70 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a4d20700 1 -- 172.21.15.82:0/1535788645 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5488003230 con 0x7f54a00a4b70 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a4d20700 1 -- 172.21.15.82:0/1535788645 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633013342 0 0) 0x7f54a00a5820 con 0x7f54a0136870 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a5d22700 1 -- 172.21.15.82:0/1535788645 >> v1:172.21.15.82:6789/0 conn(0x7f54a00a4b70 legacy=0x7f54a0136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a5d22700 1 -- 172.21.15.82:0/1535788645 >> v1:172.21.15.50:6789/0 conn(0x7f54a0136870 legacy=0x7f54a0140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a5d22700 1 -- 172.21.15.82:0/1535788645 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00a4670 con 0x7f54a00a2ab0 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.111+0000 7f54a5d22700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5490002f30 tx=0x7f54900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a5d22700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5490002f30 tx=0x7f54900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a5d22700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54900088e0).ready entity=mon.2 client_cookie=fe3144dcb07ed5c2 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a5d22700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a4d20700 1 -- 172.21.15.82:0/1535788645 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5490008e40 con 0x7f54a00a2ab0 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a5d22700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a4d20700 1 -- 172.21.15.82:0/1535788645 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54900115f0 con 0x7f54a00a2ab0 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a5d22700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a4d20700 1 -- 172.21.15.82:0/1535788645 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5490011990 con 0x7f54a00a2ab0 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a7f86700 1 -- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 msgr2=0x7f54a00aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a7f86700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54900088e0).stop 2020-04-02T23:47:13.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a7f86700 1 -- 172.21.15.82:0/1535788645 shutdown_connections 2020-04-02T23:47:13.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a7f86700 1 --2- 172.21.15.82:0/1535788645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a2ab0 0x7f54a00aae80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a7f86700 1 -- 172.21.15.82:0/1535788645 >> 172.21.15.82:0/1535788645 conn(0x7f54a009de60 msgr2=0x7f54a009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:13.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a7f86700 1 -- 172.21.15.82:0/1535788645 shutdown_connections 2020-04-02T23:47:13.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.112+0000 7f54a7f86700 1 -- 172.21.15.82:0/1535788645 wait complete. 2020-04-02T23:47:13.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.113+0000 7f54a7f86700 1 Processor -- start 2020-04-02T23:47:13.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.113+0000 7f54a7f86700 1 -- start start 2020-04-02T23:47:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a7f86700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54a00a2ab0 0x7f54a0137900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a7f86700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a4b70 0x7f54a0137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a7f86700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a0139540 con 0x7f54a0136870 2020-04-02T23:47:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a7f86700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a0138910 con 0x7f54a00a2ab0 2020-04-02T23:47:13.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a7f86700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0136f00 con 0x7f54a00a4b70 2020-04-02T23:47:13.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54a00a2ab0 0x7f54a0137900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54a00a2ab0 0x7f54a0137900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54512/0 (socket says 172.21.15.82:54512) 2020-04-02T23:47:13.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 -- 172.21.15.82:0/371714788 learned_addr learned my addr 172.21.15.82:0/371714788 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:13.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a6523700 1 --1- 172.21.15.82:0/371714788 >> v1:172.21.15.82:6789/0 conn(0x7f54a0136870 0x7f54a012d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54566/0 (socket says 172.21.15.82:54566) 2020-04-02T23:47:13.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 -- 172.21.15.82:0/371714788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a4b70 msgr2=0x7f54a0137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a4b70 0x7f54a0137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 -- 172.21.15.82:0/371714788 >> v1:172.21.15.82:6789/0 conn(0x7f54a0136870 legacy=0x7f54a012d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442425034 0 0) 0x7f54a0139540 con 0x7f54a0136870 2020-04-02T23:47:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 -- 172.21.15.82:0/371714788 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a01371a0 con 0x7f54a00a2ab0 2020-04-02T23:47:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> v2:172.21.15.82:3300/0 conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> v2:172.21.15.82:3300/0 conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.114+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5490007150 con 0x7f54a00a2ab0 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.115+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0137440 con 0x7f54a00a2ab0 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.115+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.115+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54900072b0 con 0x7f54a00a2ab0 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.115+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.115+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54900056c0 con 0x7f54a00a2ab0 2020-04-02T23:47:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.115+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0138240 con 0x7f54a00a2ab0 2020-04-02T23:47:13.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.115+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5490005940 con 0x7f54a00a2ab0 2020-04-02T23:47:13.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a009f020 con 0x7f54a00a2ab0 2020-04-02T23:47:13.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f548effd700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 0x7f548004f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5490061560 con 0x7f54a00a2ab0 2020-04-02T23:47:13.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f54a5521700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 0x7f548004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f54a5521700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 0x7f548004f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f549c0010d0 tx=0x7f549c001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f54a5521700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 0x7f548004f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f549c0010d0 tx=0x7f549c001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.116+0000 7f54a5521700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 0x7f548004f800 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f549c0010d0 tx=0x7f549c001d10).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.119+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.119+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f549003cd00 con 0x7f54a00a2ab0 2020-04-02T23:47:13.261 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.258+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f54a0056c50 con 0x7f54a00a2ab0 2020-04-02T23:47:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.258+0000 7f54a5d22700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.258+0000 7f548effd700 1 -- 172.21.15.82:0/371714788 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5490040320 con 0x7f54a00a2ab0 2020-04-02T23:47:13.262 INFO:teuthology.orchestra.run.smithi082.stdout:60129542150 2020-04-02T23:47:13.264 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.259+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 msgr2=0x7f548004f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.259+0000 7f54a7f86700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 0x7f548004f800 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f549c0010d0 tx=0x7f549c001d10).stop 2020-04-02T23:47:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.259+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 msgr2=0x7f54a0137900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.259+0000 7f54a7f86700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f5490002f30 tx=0x7f54a00a2e90).stop 2020-04-02T23:47:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.260+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 shutdown_connections 2020-04-02T23:47:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.260+0000 7f54a7f86700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f548004d340 0x7f548004f800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.260+0000 7f54a7f86700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54a00a2ab0 0x7f54a0137900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.260+0000 7f54a7f86700 1 --2- 172.21.15.82:0/371714788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f54a00a4b70 0x7f54a0137d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.260+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 >> 172.21.15.82:0/371714788 conn(0x7f54a009de60 msgr2=0x7f54a01355d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:13.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.260+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 shutdown_connections 2020-04-02T23:47:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.260+0000 7f54a7f86700 1 -- 172.21.15.82:0/371714788 wait complete. 2020-04-02T23:47:13.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.7 2020-04-02T23:47:13.273 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-02T23:47:13.273 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:13.287 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:47:13.432 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.429+0000 7f7c5bd42700 1 Processor -- start 2020-04-02T23:47:13.433 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.429+0000 7f7c5bd42700 1 -- start start 2020-04-02T23:47:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c5bd42700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c540a4b70 0x7f7c540a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c5bd42700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c54136160 0x7f7c541365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c5bd42700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540a5820 con 0x7f7c540a2ab0 2020-04-02T23:47:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c5bd42700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540a4130 con 0x7f7c54136160 2020-04-02T23:47:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c5bd42700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540a43d0 con 0x7f7c540a4b70 2020-04-02T23:47:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c592dd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c540a4b70 0x7f7c540a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c592dd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c540a4b70 0x7f7c540a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54524/0 (socket says 172.21.15.82:54524) 2020-04-02T23:47:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c592dd700 1 -- 172.21.15.82:0/3131460285 learned_addr learned my addr 172.21.15.82:0/3131460285 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.430+0000 7f7c5a2df700 1 --2- 172.21.15.82:0/3131460285 >> v2:172.21.15.50:3300/0 conn(0x7f7c54136160 0x7f7c541365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 -- 172.21.15.82:0/3131460285 >> v2:172.21.15.50:3300/0 conn(0x7f7c54136160 msgr2=0x7f7c541365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 --2- 172.21.15.82:0/3131460285 >> v2:172.21.15.50:3300/0 conn(0x7f7c54136160 0x7f7c541365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 -- 172.21.15.82:0/3131460285 >> v1:172.21.15.50:6789/0 conn(0x7f7c540a2ab0 legacy=0x7f7c540aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 -- 172.21.15.82:0/3131460285 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540a4670 con 0x7f7c540a4b70 2020-04-02T23:47:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5a2df700 1 --2- 172.21.15.82:0/3131460285 >> v2:172.21.15.50:3300/0 conn(0x7f7c54136160 0x7f7c541365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 --2- 172.21.15.82:0/3131460285 >> v2:172.21.15.82:3300/0 conn(0x7f7c540a4b70 0x7f7c540a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c5405f560 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 --2- 172.21.15.82:0/3131460285 >> v2:172.21.15.82:3300/0 conn(0x7f7c540a4b70 0x7f7c540a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c5405f560 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 --2- 172.21.15.82:0/3131460285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a4b70 0x7f7c540a4ff0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f7c5405f560 tx=0x7f7c50007a40).ready entity=mon.1 client_cookie=90bf840fd7f2bca5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 --2- 172.21.15.82:0/3131460285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a4b70 0x7f7c540a4ff0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f7c5405f560 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c58adc700 1 -- 172.21.15.82:0/3131460285 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c500116e0 con 0x7f7c540a4b70 2020-04-02T23:47:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 --2- 172.21.15.82:0/3131460285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a4b70 0x7f7c540a4ff0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f7c5405f560 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c592dd700 1 --2- 172.21.15.82:0/3131460285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a4b70 0x7f7c540a4ff0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f7c5405f560 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c58adc700 1 -- 172.21.15.82:0/3131460285 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50011840 con 0x7f7c540a4b70 2020-04-02T23:47:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c58adc700 1 -- 172.21.15.82:0/3131460285 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c50011c20 con 0x7f7c540a4b70 2020-04-02T23:47:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 -- 172.21.15.82:0/3131460285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a4b70 msgr2=0x7f7c540a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 --2- 172.21.15.82:0/3131460285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a4b70 0x7f7c540a4ff0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f7c5405f560 tx=0x7f7c50007a40).stop 2020-04-02T23:47:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 -- 172.21.15.82:0/3131460285 shutdown_connections 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 --2- 172.21.15.82:0/3131460285 >> v2:172.21.15.50:3300/0 conn(0x7f7c54136160 0x7f7c541365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 --2- 172.21.15.82:0/3131460285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a4b70 0x7f7c540a4ff0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 -- 172.21.15.82:0/3131460285 >> 172.21.15.82:0/3131460285 conn(0x7f7c5409de60 msgr2=0x7f7c5409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 -- 172.21.15.82:0/3131460285 shutdown_connections 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.431+0000 7f7c5bd42700 1 -- 172.21.15.82:0/3131460285 wait complete. 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.432+0000 7f7c5bd42700 1 Processor -- start 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.432+0000 7f7c5bd42700 1 -- start start 2020-04-02T23:47:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c5bd42700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c540a2ab0 0x7f7c540a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c5bd42700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540a1bb0 con 0x7f7c540a4b70 2020-04-02T23:47:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c5bd42700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540a1e50 con 0x7f7c54136160 2020-04-02T23:47:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c5bd42700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540a20f0 con 0x7f7c540a2ab0 2020-04-02T23:47:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c540a2ab0 0x7f7c540a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c5a2df700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7c54136160 0x7f7c5414ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54580/0 (socket says 172.21.15.82:54580) 2020-04-02T23:47:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c540a2ab0 0x7f7c540a1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54526/0 (socket says 172.21.15.82:54526) 2020-04-02T23:47:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c5a2df700 1 -- 172.21.15.82:0/117561089 learned_addr learned my addr 172.21.15.82:0/117561089 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 -- 172.21.15.82:0/117561089 >> v1:172.21.15.82:6789/0 conn(0x7f7c54136160 legacy=0x7f7c5414ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 -- 172.21.15.82:0/117561089 >> v1:172.21.15.50:6789/0 conn(0x7f7c540a4b70 legacy=0x7f7c541305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 -- 172.21.15.82:0/117561089 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540668b0 con 0x7f7c540a2ab0 2020-04-02T23:47:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> v2:172.21.15.82:3300/0 conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> v2:172.21.15.82:3300/0 conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c42ffd700 1 -- 172.21.15.82:0/117561089 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c44006cb0 con 0x7f7c540a2ab0 2020-04-02T23:47:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c42ffd700 1 -- 172.21.15.82:0/117561089 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44006e10 con 0x7f7c540a2ab0 2020-04-02T23:47:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5413b810 con 0x7f7c540a2ab0 2020-04-02T23:47:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.433+0000 7f7c42ffd700 1 -- 172.21.15.82:0/117561089 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c44008350 con 0x7f7c540a2ab0 2020-04-02T23:47:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.434+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5413a820 con 0x7f7c540a2ab0 2020-04-02T23:47:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.434+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.434+0000 7f7c42ffd700 1 -- 172.21.15.82:0/117561089 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7c44008580 con 0x7f7c540a2ab0 2020-04-02T23:47:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.434+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.435+0000 7f7c42ffd700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.435+0000 7f7c42ffd700 1 -- 172.21.15.82:0/117561089 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7c44061090 con 0x7f7c540a2ab0 2020-04-02T23:47:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.435+0000 7f7c592dd700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.435+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c54056c50 con 0x7f7c540a2ab0 2020-04-02T23:47:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.435+0000 7f7c592dd700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c541394a0 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.435+0000 7f7c592dd700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c541394a0 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.435+0000 7f7c592dd700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f7c541394a0 tx=0x7f7c50007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.438+0000 7f7c59ade700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.438+0000 7f7c42ffd700 1 -- 172.21.15.82:0/117561089 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7c4403c790 con 0x7f7c540a2ab0 2020-04-02T23:47:13.574 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.572+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 --> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c540a22f0 con 0x7f7c3404d5a0 2020-04-02T23:47:13.580 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.575+0000 7f7c592dd700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c541394a0 tx=0x7f7c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.581 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.575+0000 7f7c42ffd700 1 -- 172.21.15.82:0/117561089 <== mgr.4100 v2:172.21.15.82:6800/23559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82476 (secure 0 0 0) 0x7f7c500085c0 con 0x7f7c3404d5a0 2020-04-02T23:47:13.581 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 msgr2=0x7f7c3404fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.581 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f7c541394a0 tx=0x7f7c50007a40).stop 2020-04-02T23:47:13.581 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 msgr2=0x7f7c540a1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.581 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f7c4c0032b0 tx=0x7f7c44010880).stop 2020-04-02T23:47:13.582 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 shutdown_connections 2020-04-02T23:47:13.582 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f7c3404d5a0 0x7f7c3404fa60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.582 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 --2- 172.21.15.82:0/117561089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c540a2ab0 0x7f7c540a1200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.582 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.576+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 >> 172.21.15.82:0/117561089 conn(0x7f7c5409de60 msgr2=0x7f7c54068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:13.583 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.577+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 shutdown_connections 2020-04-02T23:47:13.585 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.577+0000 7f7c5bd42700 1 -- 172.21.15.82:0/117561089 wait complete. 2020-04-02T23:47:13.585 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2020-04-02T23:47:13.585 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:13.589 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2020-04-02T23:47:12.413859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390880,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583840,"statfs":{"total":773094113280,"available":764501852160,"internally_reserved":8589934592,"allocated":2260992,"data_stored":902940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.717661"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715680+0000","last_change":"2020-04-02T23:47:03.714314+0000","last_active":"2020-04-02T23:47:03.715680+0000","last_peered":"2020-04-02T23:47:03.715680+0000","last_clean":"2020-04-02T23:47:03.715680+0000","last_became_active":"2020-04-02T23:47:03.713811+0000","last_became_peered":"2020-04-02T23:47:03.713811+0000","last_unstale":"2020-04-02T23:47:03.715680+0000","last_undegraded":"2020-04-02T23:47:03.715680+0000","last_fullsized":"2020-04-02T23:47:03.715680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697696+0000","last_change":"2020-04-02T23:46:57.674049+0000","last_active":"2020-04-02T23:47:03.697696+0000","last_peered":"2020-04-02T23:47:03.697696+0000","last_clean":"2020-04-02T23:47:03.697696+0000","last_became_active":"2020-04-02T23:46:57.673620+0000","last_became_peered":"2020-04-02T23:46:57.673620+0000","last_unstale":"2020-04-02T23:47:03.697696+0000","last_undegraded":"2020-04-02T23:47:03.697696+0000","last_fullsized":"2020-04-02T23:47:03.697696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716636+0000","last_change":"2020-04-02T23:47:00.307706+0000","last_active":"2020-04-02T23:47:06.716636+0000","last_peered":"2020-04-02T23:47:06.716636+0000","last_clean":"2020-04-02T23:47:06.716636+0000","last_became_active":"2020-04-02T23:47:00.307374+0000","last_became_peered":"2020-04-02T23:47:00.307374+0000","last_unstale":"2020-04-02T23:47:06.716636+0000","last_undegraded":"2020-04-02T23:47:06.716636+0000","last_fullsized":"2020-04-02T23:47:06.716636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715699+0000","last_change":"2020-04-02T23:47:03.714516+0000","last_active":"2020-04-02T23:47:03.715699+0000","last_peered":"2020-04-02T23:47:03.715699+0000","last_clean":"2020-04-02T23:47:03.715699+0000","last_became_active":"2020-04-02T23:47:03.713962+0000","last_became_peered":"2020-04-02T23:47:03.713962+0000","last_unstale":"2020-04-02T23:47:03.715699+0000","last_undegraded":"2020-04-02T23:47:03.715699+0000","last_fullsized":"2020-04-02T23:47:03.715699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697727+0000","last_change":"2020-04-02T23:46:57.673991+0000","last_active":"2020-04-02T23:47:03.697727+0000","last_peered":"2020-04-02T23:47:03.697727+0000","last_clean":"2020-04-02T23:47:03.697727+0000","last_became_active":"2020-04-02T23:46:57.673652+0000","last_became_peered":"2020-04-02T23:46:57.673652+0000","last_unstale":"2020-04-02T23:47:03.697727+0000","last_undegraded":"2020-04-02T23:47:03.697727+0000","last_fullsized":"2020-04-02T23:47:03.697727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712383+0000","last_change":"2020-04-02T23:47:00.308262+0000","last_active":"2020-04-02T23:47:06.712383+0000","last_peered":"2020-04-02T23:47:06.712383+0000","last_clean":"2020-04-02T23:47:06.712383+0000","last_became_active":"2020-04-02T23:47:00.307823+0000","last_became_peered":"2020-04-02T23:47:00.307823+0000","last_unstale":"2020-04-02T23:47:06.712383+0000","last_undegraded":"2020-04-02T23:47:06.712383+0000","last_fullsized":"2020-04-02T23:47:06.712383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715743+0000","last_change":"2020-04-02T23:47:03.714531+0000","last_active":"2020-04-02T23:47:03.715743+0000","last_peered":"2020-04-02T23:47:03.715743+0000","last_clean":"2020-04-02T23:47:03.715743+0000","last_became_active":"2020-04-02T23:47:03.713973+0000","last_became_peered":"2020-04-02T23:47:03.713973+0000","last_unstale":"2020-04-02T23:47:03.715743+0000","last_undegraded":"2020-04-02T23:47:03.715743+0000","last_fullsized":"2020-04-02T23:47:03.715743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.712773+0000","last_change":"2020-04-02T23:46:57.296429+0000","last_active":"2020-04-02T23:47:03.712773+0000","last_peered":"2020-04-02T23:47:03.712773+0000","last_clean":"2020-04-02T23:47:03.712773+0000","last_became_active":"2020-04-02T23:46:57.295976+0000","last_became_peered":"2020-04-02T23:46:57.295976+0000","last_unstale":"2020-04-02T23:47:03.712773+0000","last_undegraded":"2020-04-02T23:47:03.712773+0000","last_fullsized":"2020-04-02T23:47:03.712773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.714311+0000","last_change":"2020-04-02T23:47:00.850250+0000","last_active":"2020-04-02T23:47:06.714311+0000","last_peered":"2020-04-02T23:47:06.714311+0000","last_clean":"2020-04-02T23:47:06.714311+0000","last_became_active":"2020-04-02T23:47:00.849814+0000","last_became_peered":"2020-04-02T23:47:00.849814+0000","last_unstale":"2020-04-02T23:47:06.714311+0000","last_undegraded":"2020-04-02T23:47:06.714311+0000","last_fullsized":"2020-04-02T23:47:06.714311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.713953+0000","last_change":"2020-04-02T23:47:03.713504+0000","last_active":"2020-04-02T23:47:03.713953+0000","last_peered":"2020-04-02T23:47:03.713953+0000","last_clean":"2020-04-02T23:47:03.713953+0000","last_became_active":"2020-04-02T23:47:03.713114+0000","last_became_peered":"2020-04-02T23:47:03.713114+0000","last_unstale":"2020-04-02T23:47:03.713953+0000","last_undegraded":"2020-04-02T23:47:03.713953+0000","last_fullsized":"2020-04-02T23:47:03.713953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697497+0000","last_change":"2020-04-02T23:46:57.539513+0000","last_active":"2020-04-02T23:47:03.697497+0000","last_peered":"2020-04-02T23:47:03.697497+0000","last_clean":"2020-04-02T23:47:03.697497+0000","last_became_active":"2020-04-02T23:46:57.539173+0000","last_became_peered":"2020-04-02T23:46:57.539173+0000","last_unstale":"2020-04-02T23:47:03.697497+0000","last_undegraded":"2020-04-02T23:47:03.697497+0000","last_fullsized":"2020-04-02T23:47:03.697497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.699451+0000","last_change":"2020-04-02T23:46:52.433271+0000","last_active":"2020-04-02T23:47:03.699451+0000","last_peered":"2020-04-02T23:47:03.699451+0000","last_clean":"2020-04-02T23:47:03.699451+0000","last_became_active":"2020-04-02T23:46:52.432634+0000","last_became_peered":"2020-04-02T23:46:52.432634+0000","last_unstale":"2020-04-02T23:47:03.699451+0000","last_undegraded":"2020-04-02T23:47:03.699451+0000","last_fullsized":"2020-04-02T23:47:03.699451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_clean_scrub_stamp":"2020-04-02T23:46:43.408483+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:04.699349+0000","last_change":"2020-04-02T23:47:00.308009+0000","last_active":"2020-04-02T23:47:04.699349+0000","last_peered":"2020-04-02T23:47:04.699349+0000","last_clean":"2020-04-02T23:47:04.699349+0000","last_became_active":"2020-04-02T23:47:00.307627+0000","last_became_peered":"2020-04-02T23:47:00.307627+0000","last_unstale":"2020-04-02T23:47:04.699349+0000","last_undegraded":"2020-04-02T23:47:04.699349+0000","last_fullsized":"2020-04-02T23:47:04.699349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715345+0000","last_change":"2020-04-02T23:47:03.714857+0000","last_active":"2020-04-02T23:47:03.715345+0000","last_peered":"2020-04-02T23:47:03.715345+0000","last_clean":"2020-04-02T23:47:03.715345+0000","last_became_active":"2020-04-02T23:47:03.714083+0000","last_became_peered":"2020-04-02T23:47:03.714083+0000","last_unstale":"2020-04-02T23:47:03.715345+0000","last_undegraded":"2020-04-02T23:47:03.715345+0000","last_fullsized":"2020-04-02T23:47:03.715345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697556+0000","last_change":"2020-04-02T23:46:57.294003+0000","last_active":"2020-04-02T23:47:03.697556+0000","last_peered":"2020-04-02T23:47:03.697556+0000","last_clean":"2020-04-02T23:47:03.697556+0000","last_became_active":"2020-04-02T23:46:57.293787+0000","last_became_peered":"2020-04-02T23:46:57.293787+0000","last_unstale":"2020-04-02T23:47:03.697556+0000","last_undegraded":"2020-04-02T23:47:03.697556+0000","last_fullsized":"2020-04-02T23:47:03.697556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.701887+0000","last_change":"2020-04-02T23:47:00.308297+0000","last_active":"2020-04-02T23:47:03.701887+0000","last_peered":"2020-04-02T23:47:03.701887+0000","last_clean":"2020-04-02T23:47:03.701887+0000","last_became_active":"2020-04-02T23:47:00.307853+0000","last_became_peered":"2020-04-02T23:47:00.307853+0000","last_unstale":"2020-04-02T23:47:03.701887+0000","last_undegraded":"2020-04-02T23:47:03.701887+0000","last_fullsized":"2020-04-02T23:47:03.701887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.716205+0000","last_change":"2020-04-02T23:47:03.715568+0000","last_active":"2020-04-02T23:47:03.716205+0000","last_peered":"2020-04-02T23:47:03.716205+0000","last_clean":"2020-04-02T23:47:03.716205+0000","last_became_active":"2020-04-02T23:47:03.715040+0000","last_became_peered":"2020-04-02T23:47:03.715040+0000","last_unstale":"2020-04-02T23:47:03.716205+0000","last_undegraded":"2020-04-02T23:47:03.716205+0000","last_fullsized":"2020-04-02T23:47:03.716205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697664+0000","last_change":"2020-04-02T23:46:57.295764+0000","last_active":"2020-04-02T23:47:03.697664+0000","last_peered":"2020-04-02T23:47:03.697664+0000","last_clean":"2020-04-02T23:47:03.697664+0000","last_became_active":"2020-04-02T23:46:57.295494+0000","last_became_peered":"2020-04-02T23:46:57.295494+0000","last_unstale":"2020-04-02T23:47:03.697664+0000","last_undegraded":"2020-04-02T23:47:03.697664+0000","last_fullsized":"2020-04-02T23:47:03.697664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716992+0000","last_change":"2020-04-02T23:47:00.305677+0000","last_active":"2020-04-02T23:47:06.716992+0000","last_peered":"2020-04-02T23:47:06.716992+0000","last_clean":"2020-04-02T23:47:06.716992+0000","last_became_active":"2020-04-02T23:47:00.305290+0000","last_became_peered":"2020-04-02T23:47:00.305290+0000","last_unstale":"2020-04-02T23:47:06.716992+0000","last_undegraded":"2020-04-02T23:47:06.716992+0000","last_fullsized":"2020-04-02T23:47:06.716992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.703485+0000","last_change":"2020-04-02T23:47:03.703184+0000","last_active":"2020-04-02T23:47:03.703485+0000","last_peered":"2020-04-02T23:47:03.703485+0000","last_clean":"2020-04-02T23:47:03.703485+0000","last_became_active":"2020-04-02T23:47:03.702684+0000","last_became_peered":"2020-04-02T23:47:03.702684+0000","last_unstale":"2020-04-02T23:47:03.703485+0000","last_undegraded":"2020-04-02T23:47:03.703485+0000","last_fullsized":"2020-04-02T23:47:03.703485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'7","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716823+0000","last_change":"2020-04-02T23:47:00.306016+0000","last_active":"2020-04-02T23:47:06.716823+0000","last_peered":"2020-04-02T23:47:06.716823+0000","last_clean":"2020-04-02T23:47:06.716823+0000","last_became_active":"2020-04-02T23:47:00.305661+0000","last_became_peered":"2020-04-02T23:47:00.305661+0000","last_unstale":"2020-04-02T23:47:06.716823+0000","last_undegraded":"2020-04-02T23:47:06.716823+0000","last_fullsized":"2020-04-02T23:47:06.716823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702492+0000","last_change":"2020-04-02T23:46:57.713621+0000","last_active":"2020-04-02T23:47:03.702492+0000","last_peered":"2020-04-02T23:47:03.702492+0000","last_clean":"2020-04-02T23:47:03.702492+0000","last_became_active":"2020-04-02T23:46:57.713238+0000","last_became_peered":"2020-04-02T23:46:57.713238+0000","last_unstale":"2020-04-02T23:47:03.702492+0000","last_undegraded":"2020-04-02T23:47:03.702492+0000","last_fullsized":"2020-04-02T23:47:03.702492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702333+0000","last_change":"2020-04-02T23:47:03.702021+0000","last_active":"2020-04-02T23:47:03.702333+0000","last_peered":"2020-04-02T23:47:03.702333+0000","last_clean":"2020-04-02T23:47:03.702333+0000","last_became_active":"2020-04-02T23:47:03.701495+0000","last_became_peered":"2020-04-02T23:47:03.701495+0000","last_unstale":"2020-04-02T23:47:03.702333+0000","last_undegraded":"2020-04-02T23:47:03.702333+0000","last_fullsized":"2020-04-02T23:47:03.702333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697951+0000","last_change":"2020-04-02T23:46:57.713177+0000","last_active":"2020-04-02T23:47:03.697951+0000","last_peered":"2020-04-02T23:47:03.697951+0000","last_clean":"2020-04-02T23:47:03.697951+0000","last_became_active":"2020-04-02T23:46:57.712856+0000","last_became_peered":"2020-04-02T23:46:57.712856+0000","last_unstale":"2020-04-02T23:47:03.697951+0000","last_undegraded":"2020-04-02T23:47:03.697951+0000","last_fullsized":"2020-04-02T23:47:03.697951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712091+0000","last_change":"2020-04-02T23:47:00.850182+0000","last_active":"2020-04-02T23:47:06.712091+0000","last_peered":"2020-04-02T23:47:06.712091+0000","last_clean":"2020-04-02T23:47:06.712091+0000","last_became_active":"2020-04-02T23:47:00.849643+0000","last_became_peered":"2020-04-02T23:47:00.849643+0000","last_unstale":"2020-04-02T23:47:06.712091+0000","last_undegraded":"2020-04-02T23:47:06.712091+0000","last_fullsized":"2020-04-02T23:47:06.712091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048880,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322960,"statfs":{"total":96636764160,"available":95562711040,"internally_reserved":1073741824,"allocated":303104,"data_stored":114548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":112490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":112862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":113822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]}]}} 2020-04-02T23:47:13.593 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:13.607 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:47:13.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.751+0000 7f9ad3c76700 1 Processor -- start 2020-04-02T23:47:13.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.751+0000 7f9ad3c76700 1 -- start start 2020-04-02T23:47:13.762 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad3c76700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05c3a0 0x7f9acc060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:13.762 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad3c76700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc0a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:13.762 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad3c76700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc0628e0 con 0x7f9acc05f020 2020-04-02T23:47:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad3c76700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc0a95a0 con 0x7f9acc05f4a0 2020-04-02T23:47:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad3c76700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc05f930 con 0x7f9acc05c3a0 2020-04-02T23:47:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad2213700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc0a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad1211700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9acc05f020 0x7f9acc0a79f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54584/0 (socket says 172.21.15.82:54584) 2020-04-02T23:47:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad1211700 1 -- 172.21.15.82:0/514616012 learned_addr learned my addr 172.21.15.82:0/514616012 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad1a12700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05c3a0 0x7f9acc060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad2213700 1 -- 172.21.15.82:0/514616012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05c3a0 msgr2=0x7f9acc060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad2213700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05c3a0 0x7f9acc060cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad2213700 1 -- 172.21.15.82:0/514616012 >> v1:172.21.15.82:6789/0 conn(0x7f9acc05f020 legacy=0x7f9acc0a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad2213700 1 -- 172.21.15.82:0/514616012 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc062b10 con 0x7f9acc05f4a0 2020-04-02T23:47:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.752+0000 7f9ad0a10700 1 -- 172.21.15.82:0/514616012 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712189027 0 0) 0x7f9acc0628e0 con 0x7f9acc05f020 2020-04-02T23:47:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad2213700 1 --2- 172.21.15.82:0/514616012 >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc0a8100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad2213700 1 --2- 172.21.15.82:0/514616012 >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc0a8100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad2213700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc0a8100 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).ready entity=mon.1 client_cookie=ed5aa0f97c95fa39 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad2213700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc0a8100 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad0a10700 1 -- 172.21.15.82:0/514616012 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ac400a160 con 0x7f9acc05f4a0 2020-04-02T23:47:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad2213700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc0a8100 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad2213700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc0a8100 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad0a10700 1 -- 172.21.15.82:0/514616012 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac400a2c0 con 0x7f9acc05f4a0 2020-04-02T23:47:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad0a10700 1 -- 172.21.15.82:0/514616012 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ac400a6a0 con 0x7f9acc05f4a0 2020-04-02T23:47:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 -- 172.21.15.82:0/514616012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 msgr2=0x7f9acc0a8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc0a8100 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).stop 2020-04-02T23:47:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 -- 172.21.15.82:0/514616012 shutdown_connections 2020-04-02T23:47:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc0a8100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/514616012 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05c3a0 0x7f9acc060cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 -- 172.21.15.82:0/514616012 >> 172.21.15.82:0/514616012 conn(0x7f9acc0aa630 msgr2=0x7f9acc0ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 -- 172.21.15.82:0/514616012 shutdown_connections 2020-04-02T23:47:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.753+0000 7f9ad3c76700 1 -- 172.21.15.82:0/514616012 wait complete. 2020-04-02T23:47:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.754+0000 7f9ad3c76700 1 Processor -- start 2020-04-02T23:47:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.754+0000 7f9ad3c76700 1 -- start start 2020-04-02T23:47:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad3c76700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05f020 0x7f9acc0a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad3c76700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad3c76700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc14a430 con 0x7f9acc05c3a0 2020-04-02T23:47:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad3c76700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc14a250 con 0x7f9acc05f4a0 2020-04-02T23:47:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad3c76700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc14a6d0 con 0x7f9acc05f020 2020-04-02T23:47:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc149a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54542/0 (socket says 172.21.15.82:54542) 2020-04-02T23:47:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 -- 172.21.15.82:0/2239336771 learned_addr learned my addr 172.21.15.82:0/2239336771 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad1211700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05f020 0x7f9acc0a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 -- 172.21.15.82:0/2239336771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05f020 msgr2=0x7f9acc0a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05f020 0x7f9acc0a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 -- 172.21.15.82:0/2239336771 >> v1:172.21.15.50:6789/0 conn(0x7f9acc05c3a0 legacy=0x7f9acc146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 -- 172.21.15.82:0/2239336771 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc149ee0 con 0x7f9acc05f4a0 2020-04-02T23:47:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> v2:172.21.15.82:3300/0 conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9abaffd700 1 -- 172.21.15.82:0/2239336771 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ac400a740 con 0x7f9acc05f4a0 2020-04-02T23:47:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9abaffd700 1 -- 172.21.15.82:0/2239336771 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac4005c30 con 0x7f9acc05f4a0 2020-04-02T23:47:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc146ca0 con 0x7f9acc05f4a0 2020-04-02T23:47:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.755+0000 7f9abaffd700 1 -- 172.21.15.82:0/2239336771 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ac400f570 con 0x7f9acc05f4a0 2020-04-02T23:47:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.756+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc064e30 con 0x7f9acc05f4a0 2020-04-02T23:47:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.756+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.756+0000 7f9abaffd700 1 -- 172.21.15.82:0/2239336771 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9ac400f7e0 con 0x7f9acc05f4a0 2020-04-02T23:47:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.756+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.757+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc056c50 con 0x7f9acc05f4a0 2020-04-02T23:47:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.757+0000 7f9abaffd700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.757+0000 7f9abaffd700 1 -- 172.21.15.82:0/2239336771 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9ac4061e60 con 0x7f9acc05f4a0 2020-04-02T23:47:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.757+0000 7f9ad1a12700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.757+0000 7f9ad1a12700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9acc0a4b50 tx=0x7f9abc008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.757+0000 7f9ad1a12700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9acc0a4b50 tx=0x7f9abc008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.757+0000 7f9ad1a12700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f9acc0a4b50 tx=0x7f9abc008d10).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.760+0000 7f9ad2213700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.760+0000 7f9abaffd700 1 -- 172.21.15.82:0/2239336771 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9ac403d680 con 0x7f9acc05f4a0 2020-04-02T23:47:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.893+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 --> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9acc14a8d0 con 0x7f9aac04d5c0 2020-04-02T23:47:13.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.896+0000 7f9ad1a12700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f9acc0a4b50 tx=0x7f9abc008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:13.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.896+0000 7f9abaffd700 1 -- 172.21.15.82:0/2239336771 <== mgr.4100 v2:172.21.15.82:6800/23559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82476 (secure 0 0 0) 0x7f9abc00a1d0 con 0x7f9aac04d5c0 2020-04-02T23:47:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 msgr2=0x7f9aac04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f9acc0a4b50 tx=0x7f9abc008d10).stop 2020-04-02T23:47:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 msgr2=0x7f9acc149a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f9ac40032b0 tx=0x7f9ac4007dc0).stop 2020-04-02T23:47:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 shutdown_connections 2020-04-02T23:47:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9aac04d5c0 0x7f9aac04fa80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9acc05f4a0 0x7f9acc149a80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 --2- 172.21.15.82:0/2239336771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9acc05f020 0x7f9acc0a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 >> 172.21.15.82:0/2239336771 conn(0x7f9acc0aa630 msgr2=0x7f9acc068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 shutdown_connections 2020-04-02T23:47:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:13.897+0000 7f9ad3c76700 1 -- 172.21.15.82:0/2239336771 wait complete. 2020-04-02T23:47:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2020-04-02T23:47:13.904 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:13.910 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2020-04-02T23:47:12.413859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390880,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583840,"statfs":{"total":773094113280,"available":764501852160,"internally_reserved":8589934592,"allocated":2260992,"data_stored":902940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.717661"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715680+0000","last_change":"2020-04-02T23:47:03.714314+0000","last_active":"2020-04-02T23:47:03.715680+0000","last_peered":"2020-04-02T23:47:03.715680+0000","last_clean":"2020-04-02T23:47:03.715680+0000","last_became_active":"2020-04-02T23:47:03.713811+0000","last_became_peered":"2020-04-02T23:47:03.713811+0000","last_unstale":"2020-04-02T23:47:03.715680+0000","last_undegraded":"2020-04-02T23:47:03.715680+0000","last_fullsized":"2020-04-02T23:47:03.715680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697696+0000","last_change":"2020-04-02T23:46:57.674049+0000","last_active":"2020-04-02T23:47:03.697696+0000","last_peered":"2020-04-02T23:47:03.697696+0000","last_clean":"2020-04-02T23:47:03.697696+0000","last_became_active":"2020-04-02T23:46:57.673620+0000","last_became_peered":"2020-04-02T23:46:57.673620+0000","last_unstale":"2020-04-02T23:47:03.697696+0000","last_undegraded":"2020-04-02T23:47:03.697696+0000","last_fullsized":"2020-04-02T23:47:03.697696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716636+0000","last_change":"2020-04-02T23:47:00.307706+0000","last_active":"2020-04-02T23:47:06.716636+0000","last_peered":"2020-04-02T23:47:06.716636+0000","last_clean":"2020-04-02T23:47:06.716636+0000","last_became_active":"2020-04-02T23:47:00.307374+0000","last_became_peered":"2020-04-02T23:47:00.307374+0000","last_unstale":"2020-04-02T23:47:06.716636+0000","last_undegraded":"2020-04-02T23:47:06.716636+0000","last_fullsized":"2020-04-02T23:47:06.716636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715699+0000","last_change":"2020-04-02T23:47:03.714516+0000","last_active":"2020-04-02T23:47:03.715699+0000","last_peered":"2020-04-02T23:47:03.715699+0000","last_clean":"2020-04-02T23:47:03.715699+0000","last_became_active":"2020-04-02T23:47:03.713962+0000","last_became_peered":"2020-04-02T23:47:03.713962+0000","last_unstale":"2020-04-02T23:47:03.715699+0000","last_undegraded":"2020-04-02T23:47:03.715699+0000","last_fullsized":"2020-04-02T23:47:03.715699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697727+0000","last_change":"2020-04-02T23:46:57.673991+0000","last_active":"2020-04-02T23:47:03.697727+0000","last_peered":"2020-04-02T23:47:03.697727+0000","last_clean":"2020-04-02T23:47:03.697727+0000","last_became_active":"2020-04-02T23:46:57.673652+0000","last_became_peered":"2020-04-02T23:46:57.673652+0000","last_unstale":"2020-04-02T23:47:03.697727+0000","last_undegraded":"2020-04-02T23:47:03.697727+0000","last_fullsized":"2020-04-02T23:47:03.697727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712383+0000","last_change":"2020-04-02T23:47:00.308262+0000","last_active":"2020-04-02T23:47:06.712383+0000","last_peered":"2020-04-02T23:47:06.712383+0000","last_clean":"2020-04-02T23:47:06.712383+0000","last_became_active":"2020-04-02T23:47:00.307823+0000","last_became_peered":"2020-04-02T23:47:00.307823+0000","last_unstale":"2020-04-02T23:47:06.712383+0000","last_undegraded":"2020-04-02T23:47:06.712383+0000","last_fullsized":"2020-04-02T23:47:06.712383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715743+0000","last_change":"2020-04-02T23:47:03.714531+0000","last_active":"2020-04-02T23:47:03.715743+0000","last_peered":"2020-04-02T23:47:03.715743+0000","last_clean":"2020-04-02T23:47:03.715743+0000","last_became_active":"2020-04-02T23:47:03.713973+0000","last_became_peered":"2020-04-02T23:47:03.713973+0000","last_unstale":"2020-04-02T23:47:03.715743+0000","last_undegraded":"2020-04-02T23:47:03.715743+0000","last_fullsized":"2020-04-02T23:47:03.715743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.712773+0000","last_change":"2020-04-02T23:46:57.296429+0000","last_active":"2020-04-02T23:47:03.712773+0000","last_peered":"2020-04-02T23:47:03.712773+0000","last_clean":"2020-04-02T23:47:03.712773+0000","last_became_active":"2020-04-02T23:46:57.295976+0000","last_became_peered":"2020-04-02T23:46:57.295976+0000","last_unstale":"2020-04-02T23:47:03.712773+0000","last_undegraded":"2020-04-02T23:47:03.712773+0000","last_fullsized":"2020-04-02T23:47:03.712773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.714311+0000","last_change":"2020-04-02T23:47:00.850250+0000","last_active":"2020-04-02T23:47:06.714311+0000","last_peered":"2020-04-02T23:47:06.714311+0000","last_clean":"2020-04-02T23:47:06.714311+0000","last_became_active":"2020-04-02T23:47:00.849814+0000","last_became_peered":"2020-04-02T23:47:00.849814+0000","last_unstale":"2020-04-02T23:47:06.714311+0000","last_undegraded":"2020-04-02T23:47:06.714311+0000","last_fullsized":"2020-04-02T23:47:06.714311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.713953+0000","last_change":"2020-04-02T23:47:03.713504+0000","last_active":"2020-04-02T23:47:03.713953+0000","last_peered":"2020-04-02T23:47:03.713953+0000","last_clean":"2020-04-02T23:47:03.713953+0000","last_became_active":"2020-04-02T23:47:03.713114+0000","last_became_peered":"2020-04-02T23:47:03.713114+0000","last_unstale":"2020-04-02T23:47:03.713953+0000","last_undegraded":"2020-04-02T23:47:03.713953+0000","last_fullsized":"2020-04-02T23:47:03.713953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697497+0000","last_change":"2020-04-02T23:46:57.539513+0000","last_active":"2020-04-02T23:47:03.697497+0000","last_peered":"2020-04-02T23:47:03.697497+0000","last_clean":"2020-04-02T23:47:03.697497+0000","last_became_active":"2020-04-02T23:46:57.539173+0000","last_became_peered":"2020-04-02T23:46:57.539173+0000","last_unstale":"2020-04-02T23:47:03.697497+0000","last_undegraded":"2020-04-02T23:47:03.697497+0000","last_fullsized":"2020-04-02T23:47:03.697497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.699451+0000","last_change":"2020-04-02T23:46:52.433271+0000","last_active":"2020-04-02T23:47:03.699451+0000","last_peered":"2020-04-02T23:47:03.699451+0000","last_clean":"2020-04-02T23:47:03.699451+0000","last_became_active":"2020-04-02T23:46:52.432634+0000","last_became_peered":"2020-04-02T23:46:52.432634+0000","last_unstale":"2020-04-02T23:47:03.699451+0000","last_undegraded":"2020-04-02T23:47:03.699451+0000","last_fullsized":"2020-04-02T23:47:03.699451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_clean_scrub_stamp":"2020-04-02T23:46:43.408483+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:04.699349+0000","last_change":"2020-04-02T23:47:00.308009+0000","last_active":"2020-04-02T23:47:04.699349+0000","last_peered":"2020-04-02T23:47:04.699349+0000","last_clean":"2020-04-02T23:47:04.699349+0000","last_became_active":"2020-04-02T23:47:00.307627+0000","last_became_peered":"2020-04-02T23:47:00.307627+0000","last_unstale":"2020-04-02T23:47:04.699349+0000","last_undegraded":"2020-04-02T23:47:04.699349+0000","last_fullsized":"2020-04-02T23:47:04.699349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715345+0000","last_change":"2020-04-02T23:47:03.714857+0000","last_active":"2020-04-02T23:47:03.715345+0000","last_peered":"2020-04-02T23:47:03.715345+0000","last_clean":"2020-04-02T23:47:03.715345+0000","last_became_active":"2020-04-02T23:47:03.714083+0000","last_became_peered":"2020-04-02T23:47:03.714083+0000","last_unstale":"2020-04-02T23:47:03.715345+0000","last_undegraded":"2020-04-02T23:47:03.715345+0000","last_fullsized":"2020-04-02T23:47:03.715345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697556+0000","last_change":"2020-04-02T23:46:57.294003+0000","last_active":"2020-04-02T23:47:03.697556+0000","last_peered":"2020-04-02T23:47:03.697556+0000","last_clean":"2020-04-02T23:47:03.697556+0000","last_became_active":"2020-04-02T23:46:57.293787+0000","last_became_peered":"2020-04-02T23:46:57.293787+0000","last_unstale":"2020-04-02T23:47:03.697556+0000","last_undegraded":"2020-04-02T23:47:03.697556+0000","last_fullsized":"2020-04-02T23:47:03.697556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.701887+0000","last_change":"2020-04-02T23:47:00.308297+0000","last_active":"2020-04-02T23:47:03.701887+0000","last_peered":"2020-04-02T23:47:03.701887+0000","last_clean":"2020-04-02T23:47:03.701887+0000","last_became_active":"2020-04-02T23:47:00.307853+0000","last_became_peered":"2020-04-02T23:47:00.307853+0000","last_unstale":"2020-04-02T23:47:03.701887+0000","last_undegraded":"2020-04-02T23:47:03.701887+0000","last_fullsized":"2020-04-02T23:47:03.701887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.716205+0000","last_change":"2020-04-02T23:47:03.715568+0000","last_active":"2020-04-02T23:47:03.716205+0000","last_peered":"2020-04-02T23:47:03.716205+0000","last_clean":"2020-04-02T23:47:03.716205+0000","last_became_active":"2020-04-02T23:47:03.715040+0000","last_became_peered":"2020-04-02T23:47:03.715040+0000","last_unstale":"2020-04-02T23:47:03.716205+0000","last_undegraded":"2020-04-02T23:47:03.716205+0000","last_fullsized":"2020-04-02T23:47:03.716205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697664+0000","last_change":"2020-04-02T23:46:57.295764+0000","last_active":"2020-04-02T23:47:03.697664+0000","last_peered":"2020-04-02T23:47:03.697664+0000","last_clean":"2020-04-02T23:47:03.697664+0000","last_became_active":"2020-04-02T23:46:57.295494+0000","last_became_peered":"2020-04-02T23:46:57.295494+0000","last_unstale":"2020-04-02T23:47:03.697664+0000","last_undegraded":"2020-04-02T23:47:03.697664+0000","last_fullsized":"2020-04-02T23:47:03.697664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716992+0000","last_change":"2020-04-02T23:47:00.305677+0000","last_active":"2020-04-02T23:47:06.716992+0000","last_peered":"2020-04-02T23:47:06.716992+0000","last_clean":"2020-04-02T23:47:06.716992+0000","last_became_active":"2020-04-02T23:47:00.305290+0000","last_became_peered":"2020-04-02T23:47:00.305290+0000","last_unstale":"2020-04-02T23:47:06.716992+0000","last_undegraded":"2020-04-02T23:47:06.716992+0000","last_fullsized":"2020-04-02T23:47:06.716992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.703485+0000","last_change":"2020-04-02T23:47:03.703184+0000","last_active":"2020-04-02T23:47:03.703485+0000","last_peered":"2020-04-02T23:47:03.703485+0000","last_clean":"2020-04-02T23:47:03.703485+0000","last_became_active":"2020-04-02T23:47:03.702684+0000","last_became_peered":"2020-04-02T23:47:03.702684+0000","last_unstale":"2020-04-02T23:47:03.703485+0000","last_undegraded":"2020-04-02T23:47:03.703485+0000","last_fullsized":"2020-04-02T23:47:03.703485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'7","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716823+0000","last_change":"2020-04-02T23:47:00.306016+0000","last_active":"2020-04-02T23:47:06.716823+0000","last_peered":"2020-04-02T23:47:06.716823+0000","last_clean":"2020-04-02T23:47:06.716823+0000","last_became_active":"2020-04-02T23:47:00.305661+0000","last_became_peered":"2020-04-02T23:47:00.305661+0000","last_unstale":"2020-04-02T23:47:06.716823+0000","last_undegraded":"2020-04-02T23:47:06.716823+0000","last_fullsized":"2020-04-02T23:47:06.716823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702492+0000","last_change":"2020-04-02T23:46:57.713621+0000","last_active":"2020-04-02T23:47:03.702492+0000","last_peered":"2020-04-02T23:47:03.702492+0000","last_clean":"2020-04-02T23:47:03.702492+0000","last_became_active":"2020-04-02T23:46:57.713238+0000","last_became_peered":"2020-04-02T23:46:57.713238+0000","last_unstale":"2020-04-02T23:47:03.702492+0000","last_undegraded":"2020-04-02T23:47:03.702492+0000","last_fullsized":"2020-04-02T23:47:03.702492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702333+0000","last_change":"2020-04-02T23:47:03.702021+0000","last_active":"2020-04-02T23:47:03.702333+0000","last_peered":"2020-04-02T23:47:03.702333+0000","last_clean":"2020-04-02T23:47:03.702333+0000","last_became_active":"2020-04-02T23:47:03.701495+0000","last_became_peered":"2020-04-02T23:47:03.701495+0000","last_unstale":"2020-04-02T23:47:03.702333+0000","last_undegraded":"2020-04-02T23:47:03.702333+0000","last_fullsized":"2020-04-02T23:47:03.702333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697951+0000","last_change":"2020-04-02T23:46:57.713177+0000","last_active":"2020-04-02T23:47:03.697951+0000","last_peered":"2020-04-02T23:47:03.697951+0000","last_clean":"2020-04-02T23:47:03.697951+0000","last_became_active":"2020-04-02T23:46:57.712856+0000","last_became_peered":"2020-04-02T23:46:57.712856+0000","last_unstale":"2020-04-02T23:47:03.697951+0000","last_undegraded":"2020-04-02T23:47:03.697951+0000","last_fullsized":"2020-04-02T23:47:03.697951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712091+0000","last_change":"2020-04-02T23:47:00.850182+0000","last_active":"2020-04-02T23:47:06.712091+0000","last_peered":"2020-04-02T23:47:06.712091+0000","last_clean":"2020-04-02T23:47:06.712091+0000","last_became_active":"2020-04-02T23:47:00.849643+0000","last_became_peered":"2020-04-02T23:47:00.849643+0000","last_unstale":"2020-04-02T23:47:06.712091+0000","last_undegraded":"2020-04-02T23:47:06.712091+0000","last_fullsized":"2020-04-02T23:47:06.712091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048880,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322960,"statfs":{"total":96636764160,"available":95562711040,"internally_reserved":1073741824,"allocated":303104,"data_stored":114548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":112490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":112862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":113822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]}]}} 2020-04-02T23:47:13.917 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-02T23:47:13.917 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-02T23:47:13.917 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-02T23:47:13.917 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:13.931 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-02T23:47:14.075 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f5791be8700 1 Processor -- start 2020-04-02T23:47:14.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f5791be8700 1 -- start start 2020-04-02T23:47:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f5791be8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f578c05c1e0 0x7f578c0a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f5791be8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c0a7e50 0x7f578c0a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f5791be8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c0a4970 con 0x7f578c0a9770 2020-04-02T23:47:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f5791be8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0a4c10 con 0x7f578c05c1e0 2020-04-02T23:47:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f5791be8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c05c5c0 con 0x7f578c0a7e50 2020-04-02T23:47:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f578b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f578c05c1e0 0x7f578c0a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f578affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f578c0a9770 0x7f578c0a62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54596/0 (socket says 172.21.15.82:54596) 2020-04-02T23:47:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.073+0000 7f578affd700 1 -- 172.21.15.82:0/4220261141 learned_addr learned my addr 172.21.15.82:0/4220261141 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578bfff700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c0a7e50 0x7f578c0a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 -- 172.21.15.82:0/4220261141 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c0a7e50 msgr2=0x7f578c0a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:14.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c0a7e50 0x7f578c0a69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 -- 172.21.15.82:0/4220261141 >> v1:172.21.15.82:6789/0 conn(0x7f578c0a9770 legacy=0x7f578c0a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578a7fc700 1 -- 172.21.15.82:0/4220261141 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529436199 0 0) 0x7f578c0a4970 con 0x7f578c0a9770 2020-04-02T23:47:14.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 -- 172.21.15.82:0/4220261141 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0a82c0 con 0x7f578c05c1e0 2020-04-02T23:47:14.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 --2- 172.21.15.82:0/4220261141 >> v2:172.21.15.82:3300/0 conn(0x7f578c05c1e0 0x7f578c0a79f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f577c0032b0 tx=0x7f577c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 --2- 172.21.15.82:0/4220261141 >> v2:172.21.15.82:3300/0 conn(0x7f578c05c1e0 0x7f578c0a79f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f577c0032b0 tx=0x7f577c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c05c1e0 0x7f578c0a79f0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).ready entity=mon.1 client_cookie=e4aba0a1ecd2cfe0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c05c1e0 0x7f578c0a79f0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578a7fc700 1 -- 172.21.15.82:0/4220261141 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577c00a160 con 0x7f578c05c1e0 2020-04-02T23:47:14.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c05c1e0 0x7f578c0a79f0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578a7fc700 1 -- 172.21.15.82:0/4220261141 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c00a2c0 con 0x7f578c05c1e0 2020-04-02T23:47:14.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578b7fe700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c05c1e0 0x7f578c0a79f0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f578a7fc700 1 -- 172.21.15.82:0/4220261141 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577c00a6a0 con 0x7f578c05c1e0 2020-04-02T23:47:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f5791be8700 1 -- 172.21.15.82:0/4220261141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c05c1e0 msgr2=0x7f578c0a79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f5791be8700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c05c1e0 0x7f578c0a79f0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).stop 2020-04-02T23:47:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f5791be8700 1 -- 172.21.15.82:0/4220261141 shutdown_connections 2020-04-02T23:47:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f5791be8700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c0a7e50 0x7f578c0a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f5791be8700 1 --2- 172.21.15.82:0/4220261141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c05c1e0 0x7f578c0a79f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f5791be8700 1 -- 172.21.15.82:0/4220261141 >> 172.21.15.82:0/4220261141 conn(0x7f578c0aa630 msgr2=0x7f578c0ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.074+0000 7f5791be8700 1 -- 172.21.15.82:0/4220261141 shutdown_connections 2020-04-02T23:47:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.075+0000 7f5791be8700 1 -- 172.21.15.82:0/4220261141 wait complete. 2020-04-02T23:47:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.075+0000 7f5791be8700 1 Processor -- start 2020-04-02T23:47:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f5791be8700 1 -- start start 2020-04-02T23:47:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f5791be8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c05c1e0 0x7f578c0a3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f5791be8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f578c0a7e50 0x7f578c060ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f5791be8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c067090 con 0x7f578c0a9770 2020-04-02T23:47:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f5791be8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0a73d0 con 0x7f578c0a7e50 2020-04-02T23:47:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f5791be8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c060060 con 0x7f578c05c1e0 2020-04-02T23:47:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f578c0a7e50 0x7f578c060ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f578c0a7e50 0x7f578c060ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54554/0 (socket says 172.21.15.82:54554) 2020-04-02T23:47:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578affd700 1 -- 172.21.15.82:0/1843407955 learned_addr learned my addr 172.21.15.82:0/1843407955 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578b7fe700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c05c1e0 0x7f578c0a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578affd700 1 -- 172.21.15.82:0/1843407955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c05c1e0 msgr2=0x7f578c0a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c05c1e0 0x7f578c0a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.090 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578affd700 1 -- 172.21.15.82:0/1843407955 >> v1:172.21.15.50:6789/0 conn(0x7f578c0a9770 legacy=0x7f578c05efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.091 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.076+0000 7f578affd700 1 -- 172.21.15.82:0/1843407955 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c060300 con 0x7f578c0a7e50 2020-04-02T23:47:14.091 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> v2:172.21.15.82:3300/0 conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.091 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> v2:172.21.15.82:3300/0 conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f5788ff9700 1 -- 172.21.15.82:0/1843407955 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577400ca40 con 0x7f578c0a7e50 2020-04-02T23:47:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f5788ff9700 1 -- 172.21.15.82:0/1843407955 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577400cba0 con 0x7f578c0a7e50 2020-04-02T23:47:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f5788ff9700 1 -- 172.21.15.82:0/1843407955 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577400d0c0 con 0x7f578c0a7e50 2020-04-02T23:47:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c0605a0 con 0x7f578c0a7e50 2020-04-02T23:47:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c0ad790 con 0x7f578c0a7e50 2020-04-02T23:47:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.077+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c0a0a40 con 0x7f578c0a7e50 2020-04-02T23:47:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f5788ff9700 1 -- 172.21.15.82:0/1843407955 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f57740055c0 con 0x7f578c0a7e50 2020-04-02T23:47:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f5788ff9700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 0x7f577004fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f5788ff9700 1 -- 172.21.15.82:0/1843407955 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f57740609e0 con 0x7f578c0a7e50 2020-04-02T23:47:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f578b7fe700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 0x7f577004fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f578b7fe700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 0x7f577004fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f578b7fe700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 0x7f577004fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.078+0000 7f578b7fe700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 0x7f577004fa60 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.081+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.081+0000 7f5788ff9700 1 -- 172.21.15.82:0/1843407955 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f577403c180 con 0x7f578c0a7e50 2020-04-02T23:47:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.268+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f578c060800 con 0x7f578c0a7e50 2020-04-02T23:47:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.268+0000 7f578affd700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.269+0000 7f5788ff9700 1 -- 172.21.15.82:0/1843407955 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f578c060800 con 0x7f578c0a7e50 2020-04-02T23:47:14.272 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:14.273 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 msgr2=0x7f577004fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 0x7f577004fa60 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f577c0032b0 tx=0x7f577c007dc0).stop 2020-04-02T23:47:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 msgr2=0x7f578c060ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f5774000b80 tx=0x7f5774001e40).stop 2020-04-02T23:47:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 shutdown_connections 2020-04-02T23:47:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f577004d5a0 0x7f577004fa60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f578c05c1e0 0x7f578c0a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 --2- 172.21.15.82:0/1843407955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f578c0a7e50 0x7f578c060ac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 >> 172.21.15.82:0/1843407955 conn(0x7f578c0aa630 msgr2=0x7f578c065870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 shutdown_connections 2020-04-02T23:47:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.270+0000 7f5791be8700 1 -- 172.21.15.82:0/1843407955 wait complete. 2020-04-02T23:47:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-02T23:47:14.286 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-02T23:47:14.287 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:14.304 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:14.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.449+0000 7fbd28ff6700 1 Processor -- start 2020-04-02T23:47:14.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.449+0000 7fbd28ff6700 1 -- start start 2020-04-02T23:47:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd28ff6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd24067280 0x7fbd2409f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd28ff6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 0x7fbd241436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd28ff6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240a7ab0 con 0x7fbd2405b390 2020-04-02T23:47:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd28ff6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd24066b40 con 0x7fbd24067280 2020-04-02T23:47:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd28ff6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240a63c0 con 0x7fbd2409f610 2020-04-02T23:47:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd2259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbd2405b390 0x7fbd2413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54610/0 (socket says 172.21.15.82:54610) 2020-04-02T23:47:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd2259c700 1 -- 172.21.15.82:0/3848532562 learned_addr learned my addr 172.21.15.82:0/3848532562 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd21d9b700 1 --2- 172.21.15.82:0/3848532562 >> v2:172.21.15.50:3300/0 conn(0x7fbd24067280 0x7fbd2409f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 0x7fbd241436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262286926 0 0) 0x7fbd240a7ab0 con 0x7fbd2405b390 2020-04-02T23:47:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.450+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd04003230 con 0x7fbd2405b390 2020-04-02T23:47:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4056105232 0 0) 0x7fbd04003230 con 0x7fbd2405b390 2020-04-02T23:47:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 msgr2=0x7fbd241436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 0x7fbd241436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 >> v2:172.21.15.50:3300/0 conn(0x7fbd24067280 msgr2=0x7fbd2409f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 --2- 172.21.15.82:0/3848532562 >> v2:172.21.15.50:3300/0 conn(0x7fbd24067280 0x7fbd2409f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240a25d0 con 0x7fbd2405b390 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fbd14001a50 con 0x7fbd2405b390 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 >> v1:172.21.15.82:6789/0 conn(0x7fbd2405b390 legacy=0x7fbd2413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd04003720 0x7fbd04003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 0x7fbd040044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd24066b40 con 0x7fbd04003720 2020-04-02T23:47:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240a63c0 con 0x7fbd04004930 2020-04-02T23:47:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd04005380 con 0x7fbd2409f610 2020-04-02T23:47:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2259c700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd04003720 0x7fbd04003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd21d9b700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 0x7fbd040044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 -- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 msgr2=0x7fbd040044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd2409f610 0x7fbd040044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 -- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd04003720 msgr2=0x7fbd04003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd04003720 0x7fbd04003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 -- 172.21.15.82:0/3848532562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd04003230 con 0x7fbd04004930 2020-04-02T23:47:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd1c002f30 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd1c002f30 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fbd1c002f30 tx=0x7fbd1c010020).ready entity=mon.1 client_cookie=a9df7029f0fea594 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fbd1c002f30 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c008d30 con 0x7fbd04004930 2020-04-02T23:47:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fbd1c002f30 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fbd1c002f30 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c008e90 con 0x7fbd04004930 2020-04-02T23:47:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd2159a700 1 -- 172.21.15.82:0/3848532562 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c010a90 con 0x7fbd04004930 2020-04-02T23:47:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd28ff6700 1 -- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 msgr2=0x7fbd04004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd28ff6700 1 --2- 172.21.15.82:0/3848532562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd04004930 0x7fbd04004db0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fbd1c002f30 tx=0x7fbd1c010020).stop 2020-04-02T23:47:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.451+0000 7fbd22d9d700 1 -- 172.21.15.82:0/3848532562 reap_dead start 2020-04-02T23:47:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.452+0000 7fbd28ff6700 1 -- 172.21.15.82:0/3848532562 shutdown_connections 2020-04-02T23:47:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.452+0000 7fbd28ff6700 1 -- 172.21.15.82:0/3848532562 >> 172.21.15.82:0/3848532562 conn(0x7fbd240614c0 msgr2=0x7fbd240ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.452+0000 7fbd28ff6700 1 -- 172.21.15.82:0/3848532562 shutdown_connections 2020-04-02T23:47:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.452+0000 7fbd28ff6700 1 -- 172.21.15.82:0/3848532562 wait complete. 2020-04-02T23:47:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd28ff6700 1 Processor -- start 2020-04-02T23:47:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd28ff6700 1 -- start start 2020-04-02T23:47:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd28ff6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd241369d0 0x7fbd24152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd28ff6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240a23a0 con 0x7fbd2413c6a0 2020-04-02T23:47:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd28ff6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2413af60 con 0x7fbd241384c0 2020-04-02T23:47:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd28ff6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2413cb30 con 0x7fbd241369d0 2020-04-02T23:47:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd22d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd241369d0 0x7fbd24152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd2259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbd241384c0 0x7fbd2409eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54622/0 (socket says 172.21.15.82:54622) 2020-04-02T23:47:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.453+0000 7fbd2259c700 1 -- 172.21.15.82:0/378876559 learned_addr learned my addr 172.21.15.82:0/378876559 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 -- 172.21.15.82:0/378876559 >> v1:172.21.15.82:6789/0 conn(0x7fbd241384c0 legacy=0x7fbd2409eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 -- 172.21.15.82:0/378876559 >> v1:172.21.15.50:6789/0 conn(0x7fbd2413c6a0 legacy=0x7fbd241362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873902881 0 0) 0x7fbd2413af60 con 0x7fbd241384c0 2020-04-02T23:47:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 -- 172.21.15.82:0/378876559 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24136e40 con 0x7fbd241369d0 2020-04-02T23:47:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> v2:172.21.15.82:3300/0 conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> v2:172.21.15.82:3300/0 conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c010d20 con 0x7fbd241369d0 2020-04-02T23:47:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c010e80 con 0x7fbd241369d0 2020-04-02T23:47:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2413c3f0 con 0x7fbd241369d0 2020-04-02T23:47:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c0058b0 con 0x7fbd241369d0 2020-04-02T23:47:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2409d3a0 con 0x7fbd241369d0 2020-04-02T23:47:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.454+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbd1c005a10 con 0x7fbd241369d0 2020-04-02T23:47:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd24056c50 con 0x7fbd241369d0 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd1b7fe700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 0x7fbd0804f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbd1c0606f0 con 0x7fbd241369d0 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd2259c700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 0x7fbd0804f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd2259c700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 0x7fbd0804f850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd1400ecc0 tx=0x7fbd2409c010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd2259c700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 0x7fbd0804f850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd1400ecc0 tx=0x7fbd2409c010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.455+0000 7fbd2259c700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 0x7fbd0804f850 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fbd1400ecc0 tx=0x7fbd2409c010).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.458+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.458+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fbd1c03bf10 con 0x7fbd241369d0 2020-04-02T23:47:14.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.595+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd24136e40 con 0x7fbd241369d0 2020-04-02T23:47:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.596+0000 7fbd22d9d700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.596+0000 7fbd1b7fe700 1 -- 172.21.15.82:0/378876559 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fbd24136e40 con 0x7fbd241369d0 2020-04-02T23:47:14.599 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:14.599 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 msgr2=0x7fbd0804f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 0x7fbd0804f850 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fbd1400ecc0 tx=0x7fbd2409c010).stop 2020-04-02T23:47:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 msgr2=0x7fbd24152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fbd2405b860 tx=0x7fbd1c010020).stop 2020-04-02T23:47:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 shutdown_connections 2020-04-02T23:47:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbd0804d390 0x7fbd0804f850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 --2- 172.21.15.82:0/378876559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd241369d0 0x7fbd24152280 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 >> 172.21.15.82:0/378876559 conn(0x7fbd240614c0 msgr2=0x7fbd24068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 shutdown_connections 2020-04-02T23:47:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.597+0000 7fbd28ff6700 1 -- 172.21.15.82:0/378876559 wait complete. 2020-04-02T23:47:14.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:42.430184+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:55.708328+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:58.921423+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:01.321018+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:47:14.612 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:14.625 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:47:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.771+0000 7fbbd5389700 1 Processor -- start 2020-04-02T23:47:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.771+0000 7fbbd5389700 1 -- start start 2020-04-02T23:47:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.771+0000 7fbbd5389700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a8410 0x7fbbd00a2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbd5389700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a50b0 0x7fbbd00a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbd5389700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd009edc0 con 0x7fbbd00a57b0 2020-04-02T23:47:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbd5389700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00a4790 con 0x7fbbd00a50b0 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbd5389700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00a25b0 con 0x7fbbd00a8410 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a8410 0x7fbbd00a2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a8410 0x7fbbd00a2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54580/0 (socket says 172.21.15.82:54580) 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 -- 172.21.15.82:0/3651423766 learned_addr learned my addr 172.21.15.82:0/3651423766 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/3651423766 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a50b0 0x7fbbd00a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 -- 172.21.15.82:0/3651423766 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a50b0 msgr2=0x7fbbd00a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- 172.21.15.82:0/3651423766 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a50b0 0x7fbbd00a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 -- 172.21.15.82:0/3651423766 >> v1:172.21.15.50:6789/0 conn(0x7fbbd00a57b0 legacy=0x7fbbd00a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 -- 172.21.15.82:0/3651423766 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00a2850 con 0x7fbbd00a8410 2020-04-02T23:47:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- 172.21.15.82:0/3651423766 >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a8410 0x7fbbd00a2f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- 172.21.15.82:0/3651423766 >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a8410 0x7fbbd00a2f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- 172.21.15.82:0/3651423766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a8410 0x7fbbd00a2f90 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).ready entity=mon.1 client_cookie=fd6b9d07527b9ab server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- 172.21.15.82:0/3651423766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a8410 0x7fbbd00a2f90 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbcdffb700 1 -- 172.21.15.82:0/3651423766 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc0011670 con 0x7fbbd00a8410 2020-04-02T23:47:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- 172.21.15.82:0/3651423766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a8410 0x7fbbd00a2f90 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbceffd700 1 --2- 172.21.15.82:0/3651423766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a8410 0x7fbbd00a2f90 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbcdffb700 1 -- 172.21.15.82:0/3651423766 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc00117d0 con 0x7fbbd00a8410 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbcdffb700 1 -- 172.21.15.82:0/3651423766 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc0011bb0 con 0x7fbbd00a8410 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbd5389700 1 -- 172.21.15.82:0/3651423766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a8410 msgr2=0x7fbbd00a2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.772+0000 7fbbd5389700 1 --2- 172.21.15.82:0/3651423766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a8410 0x7fbbd00a2f90 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).stop 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.773+0000 7fbbd5389700 1 -- 172.21.15.82:0/3651423766 shutdown_connections 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.773+0000 7fbbd5389700 1 --2- 172.21.15.82:0/3651423766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a8410 0x7fbbd00a2f90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.773+0000 7fbbd5389700 1 --2- 172.21.15.82:0/3651423766 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a50b0 0x7fbbd00a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.773+0000 7fbbd5389700 1 -- 172.21.15.82:0/3651423766 >> 172.21.15.82:0/3651423766 conn(0x7fbbd00ab970 msgr2=0x7fbbd00a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.773+0000 7fbbd5389700 1 -- 172.21.15.82:0/3651423766 shutdown_connections 2020-04-02T23:47:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.773+0000 7fbbd5389700 1 -- 172.21.15.82:0/3651423766 wait complete. 2020-04-02T23:47:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 Processor -- start 2020-04-02T23:47:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 -- start start 2020-04-02T23:47:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbd00a50b0 0x7fbbd0063dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a57b0 0x7fbbd0061a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a8410 0x7fbbd0061e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00654a0 con 0x7fbbd00a8410 2020-04-02T23:47:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00639c0 con 0x7fbbd00a57b0 2020-04-02T23:47:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbd5389700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0063bf0 con 0x7fbbd00a50b0 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbce7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a57b0 0x7fbbd0061a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbce7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a57b0 0x7fbbd0061a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54588/0 (socket says 172.21.15.82:54588) 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbce7fc700 1 -- 172.21.15.82:0/622431616 learned_addr learned my addr 172.21.15.82:0/622431616 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbcf7fe700 1 --2- 172.21.15.82:0/622431616 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a8410 0x7fbbd0061e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.774+0000 7fbbceffd700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbd00a50b0 0x7fbbd0063dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 -- 172.21.15.82:0/622431616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbd00a50b0 msgr2=0x7fbbd0063dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbd00a50b0 0x7fbbd0063dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 -- 172.21.15.82:0/622431616 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a8410 msgr2=0x7fbbd0061e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a8410 0x7fbbd0061e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 -- 172.21.15.82:0/622431616 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00a1190 con 0x7fbbd00a57b0 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> v2:172.21.15.82:3300/0 conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbbffff700 1 -- 172.21.15.82:0/622431616 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc4007530 con 0x7fbbd00a57b0 2020-04-02T23:47:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbbffff700 1 -- 172.21.15.82:0/622431616 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40056c0 con 0x7fbbd00a57b0 2020-04-02T23:47:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd00656d0 con 0x7fbbd00a57b0 2020-04-02T23:47:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbbffff700 1 -- 172.21.15.82:0/622431616 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc4005ae0 con 0x7fbbd00a57b0 2020-04-02T23:47:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd0065c80 con 0x7fbbd00a57b0 2020-04-02T23:47:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.775+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd0065e40 con 0x7fbbd00a57b0 2020-04-02T23:47:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbbffff700 1 -- 172.21.15.82:0/622431616 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbbc4005c40 con 0x7fbbd00a57b0 2020-04-02T23:47:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbbffff700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 0x7fbbac04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbbffff700 1 -- 172.21.15.82:0/622431616 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbbc40613a0 con 0x7fbbd00a57b0 2020-04-02T23:47:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbceffd700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 0x7fbbac04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbceffd700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 0x7fbbac04fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbceffd700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 0x7fbbac04fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.776+0000 7fbbceffd700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 0x7fbbac04fa80 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.779+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.779+0000 7fbbbffff700 1 -- 172.21.15.82:0/622431616 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fbbc403cb60 con 0x7fbbd00a57b0 2020-04-02T23:47:14.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.916+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbbd0056c50 con 0x7fbbd00a57b0 2020-04-02T23:47:14.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.917+0000 7fbbce7fc700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:14.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.917+0000 7fbbbffff700 1 -- 172.21.15.82:0/622431616 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbbc4040180 con 0x7fbbd00a57b0 2020-04-02T23:47:14.920 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2020-04-02T23:47:14.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 msgr2=0x7fbbac04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 0x7fbbac04fa80 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fbbc0002f30 tx=0x7fbbc0007a40).stop 2020-04-02T23:47:14.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 msgr2=0x7fbbd0061a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:14.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fbbc4002f30 tx=0x7fbbc4010c70).stop 2020-04-02T23:47:14.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 shutdown_connections 2020-04-02T23:47:14.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbbac04d5c0 0x7fbbac04fa80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 --2- 172.21.15.82:0/622431616 >> v2:172.21.15.50:3300/0 conn(0x7fbbd00a8410 0x7fbbd0061e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbd00a50b0 0x7fbbd0063dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 --2- 172.21.15.82:0/622431616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd00a57b0 0x7fbbd0061a30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:14.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 >> 172.21.15.82:0/622431616 conn(0x7fbbd00ab970 msgr2=0x7fbbd00a8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:14.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 shutdown_connections 2020-04-02T23:47:14.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:14.918+0000 7fbbd5389700 1 -- 172.21.15.82:0/622431616 wait complete. 2020-04-02T23:47:14.931 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:14.944 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:47:15.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f6722de8700 1 Processor -- start 2020-04-02T23:47:15.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f6722de8700 1 -- start start 2020-04-02T23:47:15.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f6722de8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671c0a66a0 0x7f671c0a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:15.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f6722de8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f671c066b00 0x7f671c066f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:15.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f6722de8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c0a2460 con 0x7f671c0a3320 2020-04-02T23:47:15.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f6722de8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c0a3b50 con 0x7f671c066b00 2020-04-02T23:47:15.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f6722de8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c0a5850 con 0x7f671c0a66a0 2020-04-02T23:47:15.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.089+0000 7f671bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671c0a66a0 0x7f671c0a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671c0a66a0 0x7f671c0a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54594/0 (socket says 172.21.15.82:54594) 2020-04-02T23:47:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 -- 172.21.15.82:0/4073555662 learned_addr learned my addr 172.21.15.82:0/4073555662 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f6721385700 1 --2- 172.21.15.82:0/4073555662 >> v2:172.21.15.50:3300/0 conn(0x7f671c066b00 0x7f671c066f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 -- 172.21.15.82:0/4073555662 >> v2:172.21.15.50:3300/0 conn(0x7f671c066b00 msgr2=0x7f671c066f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- 172.21.15.82:0/4073555662 >> v2:172.21.15.50:3300/0 conn(0x7f671c066b00 0x7f671c066f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 -- 172.21.15.82:0/4073555662 >> v1:172.21.15.50:6789/0 conn(0x7f671c0a3320 legacy=0x7f671c0a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 -- 172.21.15.82:0/4073555662 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c0a5af0 con 0x7f671c0a66a0 2020-04-02T23:47:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- 172.21.15.82:0/4073555662 >> v2:172.21.15.82:3300/0 conn(0x7f671c0a66a0 0x7f671c0a4fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- 172.21.15.82:0/4073555662 >> v2:172.21.15.82:3300/0 conn(0x7f671c0a66a0 0x7f671c0a4fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- 172.21.15.82:0/4073555662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a66a0 0x7f671c0a4fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).ready entity=mon.1 client_cookie=c65577b710fca91 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- 172.21.15.82:0/4073555662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a66a0 0x7f671c0a4fc0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671b7fe700 1 -- 172.21.15.82:0/4073555662 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6710012780 con 0x7f671c0a66a0 2020-04-02T23:47:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- 172.21.15.82:0/4073555662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a66a0 0x7f671c0a4fc0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671bfff700 1 --2- 172.21.15.82:0/4073555662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a66a0 0x7f671c0a4fc0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671b7fe700 1 -- 172.21.15.82:0/4073555662 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67100128e0 con 0x7f671c0a66a0 2020-04-02T23:47:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f671b7fe700 1 -- 172.21.15.82:0/4073555662 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6710012cc0 con 0x7f671c0a66a0 2020-04-02T23:47:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f6722de8700 1 -- 172.21.15.82:0/4073555662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a66a0 msgr2=0x7f671c0a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.090+0000 7f6722de8700 1 --2- 172.21.15.82:0/4073555662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a66a0 0x7f671c0a4fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).stop 2020-04-02T23:47:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 -- 172.21.15.82:0/4073555662 shutdown_connections 2020-04-02T23:47:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 --2- 172.21.15.82:0/4073555662 >> v2:172.21.15.50:3300/0 conn(0x7f671c066b00 0x7f671c066f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 --2- 172.21.15.82:0/4073555662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a66a0 0x7f671c0a4fc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 -- 172.21.15.82:0/4073555662 >> 172.21.15.82:0/4073555662 conn(0x7f671c0ab970 msgr2=0x7f671c0a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 -- 172.21.15.82:0/4073555662 shutdown_connections 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 -- 172.21.15.82:0/4073555662 wait complete. 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 Processor -- start 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.091+0000 7f6722de8700 1 -- start start 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f6722de8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671c0a3320 0x7f671c061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f6722de8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f671c0a66a0 0x7f671c065e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f6722de8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c0662c0 con 0x7f671c066b00 2020-04-02T23:47:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f6722de8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c1329f0 con 0x7f671c0a3320 2020-04-02T23:47:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f6722de8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c132c90 con 0x7f671c0a66a0 2020-04-02T23:47:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f671bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671c0a3320 0x7f671c061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f671bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671c0a3320 0x7f671c061560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54600/0 (socket says 172.21.15.82:54600) 2020-04-02T23:47:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f6720b84700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f671c066b00 0x7f671c130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54648/0 (socket says 172.21.15.82:54648) 2020-04-02T23:47:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f671bfff700 1 -- 172.21.15.82:0/2428443320 learned_addr learned my addr 172.21.15.82:0/2428443320 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.092+0000 7f6721385700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f671c0a66a0 0x7f671c065e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 -- 172.21.15.82:0/2428443320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f671c0a66a0 msgr2=0x7f671c065e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f671c0a66a0 0x7f671c065e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 -- 172.21.15.82:0/2428443320 >> v1:172.21.15.82:6789/0 conn(0x7f671c066b00 legacy=0x7f671c130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125160681 0 0) 0x7f671c0662c0 con 0x7f671c066b00 2020-04-02T23:47:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 -- 172.21.15.82:0/2428443320 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c132f30 con 0x7f671c0a3320 2020-04-02T23:47:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> v2:172.21.15.82:3300/0 conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> v2:172.21.15.82:3300/0 conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671000f910 con 0x7f671c0a3320 2020-04-02T23:47:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710012d40 con 0x7f671c0a3320 2020-04-02T23:47:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c131a90 con 0x7f671c0a3320 2020-04-02T23:47:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6710007530 con 0x7f671c0a3320 2020-04-02T23:47:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c068ab0 con 0x7f671c0a3320 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.093+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c056c50 con 0x7f671c0a3320 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f67100056c0 con 0x7f671c0a3320 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f6719ffb700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 0x7f66fc04f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6710062470 con 0x7f671c0a3320 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f6720b84700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 0x7f66fc04f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f6720b84700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 0x7f66fc04f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f670c000ef0 tx=0x7f670c001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.108 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.094+0000 7f6720b84700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 0x7f66fc04f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f670c000ef0 tx=0x7f670c001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.108 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.095+0000 7f6720b84700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 0x7f66fc04f900 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f670c000ef0 tx=0x7f670c001720).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.108 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.097+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.108 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.097+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f671003dc90 con 0x7f671c0a3320 2020-04-02T23:47:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.236+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f671c061290 con 0x7f671c0a3320 2020-04-02T23:47:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.236+0000 7f671bfff700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.236+0000 7f6719ffb700 1 -- 172.21.15.82:0/2428443320 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67100412b0 con 0x7f671c0a3320 2020-04-02T23:47:15.240 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 msgr2=0x7f66fc04f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 0x7f66fc04f900 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f670c000ef0 tx=0x7f670c001720).stop 2020-04-02T23:47:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 msgr2=0x7f671c061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f6710002f30 tx=0x7f6710007a40).stop 2020-04-02T23:47:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 shutdown_connections 2020-04-02T23:47:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f671c0a66a0 0x7f671c065e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f66fc04d440 0x7f66fc04f900 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 --2- 172.21.15.82:0/2428443320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671c0a3320 0x7f671c061560 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 >> 172.21.15.82:0/2428443320 conn(0x7f671c0ab970 msgr2=0x7f671c066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 shutdown_connections 2020-04-02T23:47:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.238+0000 7f6722de8700 1 -- 172.21.15.82:0/2428443320 wait complete. 2020-04-02T23:47:15.251 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:15.264 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:47:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f9b18700 1 Processor -- start 2020-04-02T23:47:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f9b18700 1 -- start start 2020-04-02T23:47:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f9b18700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f409f610 0x7ff3f40a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f9b18700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f40a3960 con 0x7ff3f40a8410 2020-04-02T23:47:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f9b18700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f40a73f0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f9b18700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40a4890 con 0x7ff3f409f610 2020-04-02T23:47:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f3fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff3f4135ff0 0x7ff3f41363f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54660/0 (socket says 172.21.15.82:54660) 2020-04-02T23:47:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.410+0000 7ff3f3fff700 1 -- 172.21.15.82:0/1777226894 learned_addr learned my addr 172.21.15.82:0/1777226894 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:15.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/1777226894 >> v2:172.21.15.50:3300/0 conn(0x7ff3f409f610 0x7ff3f40a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f27fc700 1 -- 172.21.15.82:0/1777226894 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227816641 0 0) 0x7ff3f40a73f0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f27fc700 1 -- 172.21.15.82:0/1777226894 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e0003230 con 0x7ff3f4135ff0 2020-04-02T23:47:15.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f27fc700 1 -- 172.21.15.82:0/1777226894 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3225677744 0 0) 0x7ff3e0003230 con 0x7ff3f4135ff0 2020-04-02T23:47:15.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 -- 172.21.15.82:0/1777226894 >> v1:172.21.15.82:6789/0 conn(0x7ff3f4135ff0 legacy=0x7ff3f41363f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 -- 172.21.15.82:0/1777226894 >> v1:172.21.15.50:6789/0 conn(0x7ff3f40a8410 legacy=0x7ff3f40a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.421 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 -- 172.21.15.82:0/1777226894 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f40a6a40 con 0x7ff3f409f610 2020-04-02T23:47:15.421 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/1777226894 >> v2:172.21.15.50:3300/0 conn(0x7ff3f409f610 0x7ff3f40a6e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3ec001bf0 tx=0x7ff3e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.421 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/1777226894 >> v2:172.21.15.50:3300/0 conn(0x7ff3f409f610 0x7ff3f40a6e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3ec001bf0 tx=0x7ff3e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.421 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/1777226894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f409f610 0x7ff3f40a6e70 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7ff3ec001bf0 tx=0x7ff3e8007a40).ready entity=mon.0 client_cookie=75e70e2cd10ce131 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.421 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/1777226894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f409f610 0x7ff3f40a6e70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff3ec001bf0 tx=0x7ff3e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.421 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f27fc700 1 -- 172.21.15.82:0/1777226894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec001a50 con 0x7ff3f409f610 2020-04-02T23:47:15.422 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/1777226894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f409f610 0x7ff3f40a6e70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff3ec001bf0 tx=0x7ff3e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.422 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f27fc700 1 -- 172.21.15.82:0/1777226894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8008b40 con 0x7ff3f409f610 2020-04-02T23:47:15.422 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/1777226894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f409f610 0x7ff3f40a6e70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff3ec001bf0 tx=0x7ff3e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.422 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f27fc700 1 -- 172.21.15.82:0/1777226894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3e8008ea0 con 0x7ff3f409f610 2020-04-02T23:47:15.422 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f9b18700 1 -- 172.21.15.82:0/1777226894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f409f610 msgr2=0x7ff3f40a6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.422 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.411+0000 7ff3f9b18700 1 --2- 172.21.15.82:0/1777226894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f409f610 0x7ff3f40a6e70 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7ff3ec001bf0 tx=0x7ff3e8007a40).stop 2020-04-02T23:47:15.422 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.412+0000 7ff3f9b18700 1 -- 172.21.15.82:0/1777226894 shutdown_connections 2020-04-02T23:47:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.412+0000 7ff3f9b18700 1 --2- 172.21.15.82:0/1777226894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f409f610 0x7ff3f40a6e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.412+0000 7ff3f9b18700 1 -- 172.21.15.82:0/1777226894 >> 172.21.15.82:0/1777226894 conn(0x7ff3f40ab970 msgr2=0x7ff3f40a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.412+0000 7ff3f9b18700 1 -- 172.21.15.82:0/1777226894 shutdown_connections 2020-04-02T23:47:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.412+0000 7ff3f9b18700 1 -- 172.21.15.82:0/1777226894 wait complete. 2020-04-02T23:47:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f9b18700 1 Processor -- start 2020-04-02T23:47:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f9b18700 1 -- start start 2020-04-02T23:47:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f9b18700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a8410 0x7ff3f4061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f9b18700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3f4135ff0 0x7ff3f4132eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f9b18700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f4063c70 con 0x7ff3f409f610 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f9b18700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f4061e50 con 0x7ff3f40a8410 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f9b18700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40620f0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3f4135ff0 0x7ff3f4132eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f37fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff3f409f610 0x7ff3f4063560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54662/0 (socket says 172.21.15.82:54662) 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.413+0000 7ff3f37fe700 1 -- 172.21.15.82:0/737311719 learned_addr learned my addr 172.21.15.82:0/737311719 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f2ffd700 1 --2- 172.21.15.82:0/737311719 >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a8410 0x7ff3f4061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 -- 172.21.15.82:0/737311719 >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a8410 msgr2=0x7ff3f4061750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a8410 0x7ff3f4061750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 -- 172.21.15.82:0/737311719 >> v1:172.21.15.82:6789/0 conn(0x7ff3f409f610 legacy=0x7ff3f4063560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843193415 0 0) 0x7ff3f4063c70 con 0x7ff3f409f610 2020-04-02T23:47:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 -- 172.21.15.82:0/737311719 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4060b40 con 0x7ff3f4135ff0 2020-04-02T23:47:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> v2:172.21.15.82:3300/0 conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> v2:172.21.15.82:3300/0 conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec00ccd0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec00ce30 con 0x7ff3f4135ff0 2020-04-02T23:47:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f413ae50 con 0x7ff3f4135ff0 2020-04-02T23:47:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec012ac0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.414+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f4060fe0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f4056c50 con 0x7ff3f4135ff0 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff3ec012d00 con 0x7ff3f4135ff0 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f0ff9700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 0x7ff3d404f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff3ec0610a0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f37fe700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 0x7ff3d404f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.415+0000 7ff3f37fe700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 0x7ff3d404f8c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3e4000ec0 tx=0x7ff3e4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.416+0000 7ff3f37fe700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 0x7ff3d404f8c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3e4000ec0 tx=0x7ff3e4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.416+0000 7ff3f37fe700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 0x7ff3d404f8c0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7ff3e4000ec0 tx=0x7ff3e4001780).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.429 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.418+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.429 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.418+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff3ec03c7e0 con 0x7ff3f4135ff0 2020-04-02T23:47:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.553+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3f405d150 con 0x7ff3f4135ff0 2020-04-02T23:47:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.554+0000 7ff3f3fff700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.554+0000 7ff3f0ff9700 1 -- 172.21.15.82:0/737311719 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff3ec03fe00 con 0x7ff3f4135ff0 2020-04-02T23:47:15.557 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:15.558 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 msgr2=0x7ff3d404f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 0x7ff3d404f8c0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7ff3e4000ec0 tx=0x7ff3e4001780).stop 2020-04-02T23:47:15.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 msgr2=0x7ff3f4132eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7ff3ec001cb0 tx=0x7ff3ec00c890).stop 2020-04-02T23:47:15.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 shutdown_connections 2020-04-02T23:47:15.559 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f4135ff0 0x7ff3f4132eb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 --2- 172.21.15.82:0/737311719 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff3d404d400 0x7ff3d404f8c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 --2- 172.21.15.82:0/737311719 >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a8410 0x7ff3f4061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 >> 172.21.15.82:0/737311719 conn(0x7ff3f40ab970 msgr2=0x7ff3f4068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 shutdown_connections 2020-04-02T23:47:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.555+0000 7ff3f9b18700 1 -- 172.21.15.82:0/737311719 wait complete. 2020-04-02T23:47:15.569 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:15.583 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:47:15.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 Processor -- start 2020-04-02T23:47:15.731 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 -- start start 2020-04-02T23:47:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4c40aa560 0x7fa4c413c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4c405f4f0 0x7fa4c405f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c40a9a00 con 0x7fa4c413cdc0 2020-04-02T23:47:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c413c220 con 0x7fa4c405f4f0 2020-04-02T23:47:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c413c4c0 con 0x7fa4c40aa560 2020-04-02T23:47:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4c40aa560 0x7fa4c413c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c3fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa4c413cdc0 0x7fa4c40a8ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54672/0 (socket says 172.21.15.82:54672) 2020-04-02T23:47:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4c40aa560 0x7fa4c413c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54620/0 (socket says 172.21.15.82:54620) 2020-04-02T23:47:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c3fff700 1 -- 172.21.15.82:0/2844115728 learned_addr learned my addr 172.21.15.82:0/2844115728 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c93a8700 1 --2- 172.21.15.82:0/2844115728 >> v2:172.21.15.50:3300/0 conn(0x7fa4c405f4f0 0x7fa4c405f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 -- 172.21.15.82:0/2844115728 >> v2:172.21.15.50:3300/0 conn(0x7fa4c405f4f0 msgr2=0x7fa4c405f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:15.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/2844115728 >> v2:172.21.15.50:3300/0 conn(0x7fa4c405f4f0 0x7fa4c405f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:15.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 -- 172.21.15.82:0/2844115728 >> v1:172.21.15.82:6789/0 conn(0x7fa4c413cdc0 legacy=0x7fa4c40a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.742 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 -- 172.21.15.82:0/2844115728 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40aa940 con 0x7fa4c40aa560 2020-04-02T23:47:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c37fe700 1 -- 172.21.15.82:0/2844115728 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097948994 0 0) 0x7fa4c40a9a00 con 0x7fa4c413cdc0 2020-04-02T23:47:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/2844115728 >> v2:172.21.15.82:3300/0 conn(0x7fa4c40aa560 0x7fa4c413c960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4c4060d70 tx=0x7fa4b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/2844115728 >> v2:172.21.15.82:3300/0 conn(0x7fa4c40aa560 0x7fa4c413c960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4c4060d70 tx=0x7fa4b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/2844115728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c40aa560 0x7fa4c413c960 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fa4c4060d70 tx=0x7fa4b8007a40).ready entity=mon.1 client_cookie=42147c6d95994a88 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/2844115728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c40aa560 0x7fa4c413c960 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fa4c4060d70 tx=0x7fa4b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c37fe700 1 -- 172.21.15.82:0/2844115728 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b8011430 con 0x7fa4c40aa560 2020-04-02T23:47:15.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/2844115728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c40aa560 0x7fa4c413c960 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fa4c4060d70 tx=0x7fa4b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c37fe700 1 -- 172.21.15.82:0/2844115728 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8011590 con 0x7fa4c40aa560 2020-04-02T23:47:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/2844115728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c40aa560 0x7fa4c413c960 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fa4c4060d70 tx=0x7fa4b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4c37fe700 1 -- 172.21.15.82:0/2844115728 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b8011970 con 0x7fa4c40aa560 2020-04-02T23:47:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 -- 172.21.15.82:0/2844115728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c40aa560 msgr2=0x7fa4c413c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.729+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/2844115728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c40aa560 0x7fa4c413c960 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fa4c4060d70 tx=0x7fa4b8007a40).stop 2020-04-02T23:47:15.746 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.730+0000 7fa4cae0b700 1 -- 172.21.15.82:0/2844115728 shutdown_connections 2020-04-02T23:47:15.746 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.730+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/2844115728 >> v2:172.21.15.50:3300/0 conn(0x7fa4c405f4f0 0x7fa4c405f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:15.746 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.730+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/2844115728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c40aa560 0x7fa4c413c960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.746 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.730+0000 7fa4cae0b700 1 -- 172.21.15.82:0/2844115728 >> 172.21.15.82:0/2844115728 conn(0x7fa4c40adc40 msgr2=0x7fa4c40a9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:15.746 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.730+0000 7fa4cae0b700 1 -- 172.21.15.82:0/2844115728 shutdown_connections 2020-04-02T23:47:15.746 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.730+0000 7fa4cae0b700 1 -- 172.21.15.82:0/2844115728 wait complete. 2020-04-02T23:47:15.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4cae0b700 1 Processor -- start 2020-04-02T23:47:15.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4cae0b700 1 -- start start 2020-04-02T23:47:15.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4cae0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4c40aa560 0x7fa4c4135330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4cae0b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4c413cdc0 0x7fa4c4135880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.747 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4cae0b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c413f160 con 0x7fa4c405f4f0 2020-04-02T23:47:15.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4cae0b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c4134130 con 0x7fa4c40aa560 2020-04-02T23:47:15.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4cae0b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4135ce0 con 0x7fa4c413cdc0 2020-04-02T23:47:15.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4c8ba7700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa4c405f4f0 0x7fa4c4132550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54676/0 (socket says 172.21.15.82:54676) 2020-04-02T23:47:15.748 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.731+0000 7fa4c8ba7700 1 -- 172.21.15.82:0/3610610763 learned_addr learned my addr 172.21.15.82:0/3610610763 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:15.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> v2:172.21.15.50:3300/0 conn(0x7fa4c40aa560 0x7fa4c4135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c93a8700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4c413cdc0 0x7fa4c4135880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481099681 0 0) 0x7fa4c40aa940 con 0x7fa4c405f4f0 2020-04-02T23:47:15.749 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac002fe0 con 0x7fa4c405f4f0 2020-04-02T23:47:15.750 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 -- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4c413cdc0 msgr2=0x7fa4c4135880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.750 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4c413cdc0 0x7fa4c4135880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.750 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 -- 172.21.15.82:0/3610610763 >> v1:172.21.15.82:6789/0 conn(0x7fa4c405f4f0 legacy=0x7fa4c4132550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.750 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2631573490 0 0) 0x7fa4ac002fe0 con 0x7fa4c405f4f0 2020-04-02T23:47:15.750 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 -- 172.21.15.82:0/3610610763 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4139500 con 0x7fa4c40aa560 2020-04-02T23:47:15.751 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c93a8700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4c413cdc0 0x7fa4c4135880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:15.751 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> v2:172.21.15.50:3300/0 conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.751 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> v2:172.21.15.50:3300/0 conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.751 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b8008e10 con 0x7fa4c40aa560 2020-04-02T23:47:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0005ab0 con 0x7fa4c40aa560 2020-04-02T23:47:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c4138910 con 0x7fa4c40aa560 2020-04-02T23:47:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b0005e10 con 0x7fa4c40aa560 2020-04-02T23:47:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.732+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4139810 con 0x7fa4c40aa560 2020-04-02T23:47:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.733+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.733+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4132e20 con 0x7fa4c40aa560 2020-04-02T23:47:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.733+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa4b000a320 con 0x7fa4c40aa560 2020-04-02T23:47:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.733+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.734+0000 7fa4c1ffb700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 0x7fa4ac04fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:15.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.734+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa4b0060a10 con 0x7fa4c40aa560 2020-04-02T23:47:15.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.734+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 0x7fa4ac04fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:15.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.734+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 0x7fa4ac04fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4b8010240 tx=0x7fa4b8007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.734+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 0x7fa4ac04fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4b8010240 tx=0x7fa4b8007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.734+0000 7fa4c8ba7700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 0x7fa4ac04fd40 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fa4b8010240 tx=0x7fa4b8007ae0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:15.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.739+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.739+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa4b003c090 con 0x7fa4c40aa560 2020-04-02T23:47:15.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.875+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4c4138630 con 0x7fa4c40aa560 2020-04-02T23:47:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.876+0000 7fa4c3fff700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.876+0000 7fa4c1ffb700 1 -- 172.21.15.82:0/3610610763 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa4b003f6b0 con 0x7fa4c40aa560 2020-04-02T23:47:15.879 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 msgr2=0x7fa4ac04fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 0x7fa4ac04fd40 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fa4b8010240 tx=0x7fa4b8007ae0).stop 2020-04-02T23:47:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 msgr2=0x7fa4c4135330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fa4b8008f70 tx=0x7fa4b00108c0).stop 2020-04-02T23:47:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 shutdown_connections 2020-04-02T23:47:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4c413cdc0 0x7fa4c4135880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa4ac04d880 0x7fa4ac04fd40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 --2- 172.21.15.82:0/3610610763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c40aa560 0x7fa4c4135330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 >> 172.21.15.82:0/3610610763 conn(0x7fa4c40adc40 msgr2=0x7fa4c40a7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 shutdown_connections 2020-04-02T23:47:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:15.877+0000 7fa4cae0b700 1 -- 172.21.15.82:0/3610610763 wait complete. 2020-04-02T23:47:15.891 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:15.904 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:47:16.049 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff69a6dc700 1 Processor -- start 2020-04-02T23:47:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff69a6dc700 1 -- start start 2020-04-02T23:47:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff69a6dc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff694060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff69a6dc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff69405f4a0 0x7ff6940a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff69a6dc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6940628e0 con 0x7ff69405f020 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff69a6dc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940a95a0 con 0x7ff69405c3a0 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff69a6dc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff694062b10 con 0x7ff69405f4a0 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff698c79700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff69405f4a0 0x7ff6940a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff698c79700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff69405f4a0 0x7ff6940a8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54634/0 (socket says 172.21.15.82:54634) 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.047+0000 7ff698c79700 1 -- 172.21.15.82:0/883977323 learned_addr learned my addr 172.21.15.82:0/883977323 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff693fff700 1 --2- 172.21.15.82:0/883977323 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff694060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 -- 172.21.15.82:0/883977323 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 msgr2=0x7ff694060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 --2- 172.21.15.82:0/883977323 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff694060cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 -- 172.21.15.82:0/883977323 >> v1:172.21.15.50:6789/0 conn(0x7ff69405f020 legacy=0x7ff6940a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 -- 172.21.15.82:0/883977323 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69405f8d0 con 0x7ff69405f4a0 2020-04-02T23:47:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 --2- 172.21.15.82:0/883977323 >> v2:172.21.15.82:3300/0 conn(0x7ff69405f4a0 0x7ff6940a8100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 --2- 172.21.15.82:0/883977323 >> v2:172.21.15.82:3300/0 conn(0x7ff69405f4a0 0x7ff6940a8100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 --2- 172.21.15.82:0/883977323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69405f4a0 0x7ff6940a8100 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).ready entity=mon.1 client_cookie=6fc17ffc526eef5e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 --2- 172.21.15.82:0/883977323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69405f4a0 0x7ff6940a8100 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff692ffd700 1 -- 172.21.15.82:0/883977323 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68c00a160 con 0x7ff69405f4a0 2020-04-02T23:47:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 --2- 172.21.15.82:0/883977323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69405f4a0 0x7ff6940a8100 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff698c79700 1 --2- 172.21.15.82:0/883977323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69405f4a0 0x7ff6940a8100 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff692ffd700 1 -- 172.21.15.82:0/883977323 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c00a2c0 con 0x7ff69405f4a0 2020-04-02T23:47:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff692ffd700 1 -- 172.21.15.82:0/883977323 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68c00a6a0 con 0x7ff69405f4a0 2020-04-02T23:47:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 -- 172.21.15.82:0/883977323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69405f4a0 msgr2=0x7ff6940a8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/883977323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69405f4a0 0x7ff6940a8100 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).stop 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 -- 172.21.15.82:0/883977323 shutdown_connections 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/883977323 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff694060cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/883977323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69405f4a0 0x7ff6940a8100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 -- 172.21.15.82:0/883977323 >> 172.21.15.82:0/883977323 conn(0x7ff6940aa630 msgr2=0x7ff6940ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 -- 172.21.15.82:0/883977323 shutdown_connections 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.048+0000 7ff69a6dc700 1 -- 172.21.15.82:0/883977323 wait complete. 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.049+0000 7ff69a6dc700 1 Processor -- start 2020-04-02T23:47:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.049+0000 7ff69a6dc700 1 -- start start 2020-04-02T23:47:16.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff69a6dc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff69409f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:16.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff69a6dc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:16.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff69a6dc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69409fe30 con 0x7ff69405f020 2020-04-02T23:47:16.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff69a6dc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940a00d0 con 0x7ff69405c3a0 2020-04-02T23:47:16.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff69a6dc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940a0370 con 0x7ff69405f4a0 2020-04-02T23:47:16.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff693fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff69409f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.061 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff698c79700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff693fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff69409f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:51222/0 (socket says 172.21.15.82:51222) 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff6937fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff69405f020 0x7ff6940a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58662/0 (socket says 172.21.15.82:58662) 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.050+0000 7ff693fff700 1 -- 172.21.15.82:0/1389120014 learned_addr learned my addr 172.21.15.82:0/1389120014 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 -- 172.21.15.82:0/1389120014 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 msgr2=0x7ff69409f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff69409f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 -- 172.21.15.82:0/1389120014 >> v1:172.21.15.50:6789/0 conn(0x7ff69405f020 legacy=0x7ff6940a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 -- 172.21.15.82:0/1389120014 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69413c400 con 0x7ff69405f4a0 2020-04-02T23:47:16.062 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff693fff700 1 --2- 172.21.15.82:0/1389120014 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff69409f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:16.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:16.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff6917fa700 1 -- 172.21.15.82:0/1389120014 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68c00a6e0 con 0x7ff69405f4a0 2020-04-02T23:47:16.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.063 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff6917fa700 1 -- 172.21.15.82:0/1389120014 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c005c30 con 0x7ff69405f4a0 2020-04-02T23:47:16.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6940a7060 con 0x7ff69405f4a0 2020-04-02T23:47:16.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff6917fa700 1 -- 172.21.15.82:0/1389120014 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68c005e60 con 0x7ff69405f4a0 2020-04-02T23:47:16.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.051+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6940a11f0 con 0x7ff69405f4a0 2020-04-02T23:47:16.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.052+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.052+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6940a0570 con 0x7ff69405f4a0 2020-04-02T23:47:16.064 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.052+0000 7ff6917fa700 1 -- 172.21.15.82:0/1389120014 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff68c007340 con 0x7ff69405f4a0 2020-04-02T23:47:16.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.052+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.052+0000 7ff6917fa700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 0x7ff67404f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:16.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.052+0000 7ff6917fa700 1 -- 172.21.15.82:0/1389120014 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff68c061c60 con 0x7ff69405f4a0 2020-04-02T23:47:16.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.053+0000 7ff693fff700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 0x7ff67404f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.053+0000 7ff693fff700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 0x7ff67404f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff684002f30 tx=0x7ff68400b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.053+0000 7ff693fff700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 0x7ff67404f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff684002f30 tx=0x7ff68400b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.053+0000 7ff693fff700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 0x7ff67404f9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7ff684002f30 tx=0x7ff68400b560).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:16.066 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.056+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.066 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.056+0000 7ff6917fa700 1 -- 172.21.15.82:0/1389120014 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff6940a0570 con 0x7ff69405f4a0 2020-04-02T23:47:16.241 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.238+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6940a0570 con 0x7ff69405f4a0 2020-04-02T23:47:16.241 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.238+0000 7ff698c79700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.242 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.238+0000 7ff6917fa700 1 -- 172.21.15.82:0/1389120014 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7ff6940a0570 con 0x7ff69405f4a0 2020-04-02T23:47:16.242 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:16.242 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:47:07.704695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:47:16.243 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 msgr2=0x7ff67404f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.243 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 0x7ff67404f9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7ff684002f30 tx=0x7ff68400b560).stop 2020-04-02T23:47:16.243 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 msgr2=0x7ff6941464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.244 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7ff69405eea0 tx=0x7ff68c007dc0).stop 2020-04-02T23:47:16.244 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 shutdown_connections 2020-04-02T23:47:16.244 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7ff67404d530 0x7ff67404f9f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.244 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/1389120014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff69405f4a0 0x7ff6941464f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.244 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 --2- 172.21.15.82:0/1389120014 >> v2:172.21.15.50:3300/0 conn(0x7ff69405c3a0 0x7ff69409f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.244 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 >> 172.21.15.82:0/1389120014 conn(0x7ff6940aa630 msgr2=0x7ff6940abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:16.244 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 shutdown_connections 2020-04-02T23:47:16.245 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.240+0000 7ff69a6dc700 1 -- 172.21.15.82:0/1389120014 wait complete. 2020-04-02T23:47:16.245 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2020-04-02T23:47:16.456 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4390}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4390': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4390, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1148797459, u'type': u'v2', u'addr': u'172.21.15.82:6834'}, {u'nonce': 1148797459, u'type': u'v1', u'addr': u'172.21.15.82:6835'}]}, u'addr': u'172.21.15.82:6835/1148797459'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:47:03.694261+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:47:07.704695+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:47:16.456 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:47:16.457 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:16.471 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-02T23:47:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2020-04-02T23:47:16.633 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "9ad11b85-09ab-48b2-ad7c-5536462abc65", 2020-04-02T23:47:16.633 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2020-04-02T23:47:16.633 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4390, 2020-04-02T23:47:16.633 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2020-04-02T23:47:16.633 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2020-04-02T23:47:16.633 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 9.9225803159999995, 2020-04-02T23:47:16.634 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 6, 2020-04-02T23:47:16.634 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 26, 2020-04-02T23:47:16.634 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 26, 2020-04-02T23:47:16.634 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 10.033163663 2020-04-02T23:47:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:} 2020-04-02T23:47:16.637 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "9ad11b85-09ab-48b2-ad7c-5536462abc65", "whoami": 0, "id": 4390, "want_state": "up:active", "state": "up:active", "rank_uptime": 9.9225803159999995, "mdsmap_epoch": 6, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "uptime": 10.033163663 } 2020-04-02T23:47:16.637 INFO:teuthology.run_tasks:Running task mds_thrash... 2020-04-02T23:47:16.656 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:16.670 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:16.815 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.813+0000 7f1000529700 1 Processor -- start 2020-04-02T23:47:16.815 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.813+0000 7f1000529700 1 -- start start 2020-04-02T23:47:16.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f1000529700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ff805f730 0x7f0ff8060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:16.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f1000529700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ff8140970 0x7f0ff8142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:16.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f1000529700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80628e0 con 0x7f0ff805c3a0 2020-04-02T23:47:16.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f1000529700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80a95a0 con 0x7f0ff805f730 2020-04-02T23:47:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f1000529700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff8062b10 con 0x7f0ff8140970 2020-04-02T23:47:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffeac6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ff8140970 0x7f0ff8142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffeac6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ff8140970 0x7f0ff8142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54648/0 (socket says 172.21.15.82:54648) 2020-04-02T23:47:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffeac6700 1 -- 172.21.15.82:0/1500792133 learned_addr learned my addr 172.21.15.82:0/1500792133 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffdac4700 1 --2- 172.21.15.82:0/1500792133 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805f730 0x7f0ff8060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffeac6700 1 -- 172.21.15.82:0/1500792133 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805f730 msgr2=0x7f0ff8060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/1500792133 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805f730 0x7f0ff8060cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffeac6700 1 -- 172.21.15.82:0/1500792133 >> v1:172.21.15.50:6789/0 conn(0x7f0ff805c3a0 legacy=0x7f0ff805f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.814+0000 7f0ffeac6700 1 -- 172.21.15.82:0/1500792133 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80a9770 con 0x7f0ff8140970 2020-04-02T23:47:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/1500792133 >> v2:172.21.15.82:3300/0 conn(0x7f0ff8140970 0x7f0ff8142d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/1500792133 >> v2:172.21.15.82:3300/0 conn(0x7f0ff8140970 0x7f0ff8142d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/1500792133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff8140970 0x7f0ff8142d60 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).ready entity=mon.1 client_cookie=3eb048afd427d67a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/1500792133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff8140970 0x7f0ff8142d60 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/1500792133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff8140970 0x7f0ff8142d60 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffd2c3700 1 -- 172.21.15.82:0/1500792133 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fec011670 con 0x7f0ff8140970 2020-04-02T23:47:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/1500792133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff8140970 0x7f0ff8142d60 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffd2c3700 1 -- 172.21.15.82:0/1500792133 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec0117d0 con 0x7f0ff8140970 2020-04-02T23:47:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f0ffd2c3700 1 -- 172.21.15.82:0/1500792133 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fec011bb0 con 0x7f0ff8140970 2020-04-02T23:47:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 -- 172.21.15.82:0/1500792133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff8140970 msgr2=0x7f0ff8142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 --2- 172.21.15.82:0/1500792133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff8140970 0x7f0ff8142d60 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).stop 2020-04-02T23:47:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 -- 172.21.15.82:0/1500792133 shutdown_connections 2020-04-02T23:47:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 --2- 172.21.15.82:0/1500792133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff8140970 0x7f0ff8142d60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 --2- 172.21.15.82:0/1500792133 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805f730 0x7f0ff8060cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 -- 172.21.15.82:0/1500792133 >> 172.21.15.82:0/1500792133 conn(0x7f0ff80aa630 msgr2=0x7f0ff80ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 -- 172.21.15.82:0/1500792133 shutdown_connections 2020-04-02T23:47:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.815+0000 7f1000529700 1 -- 172.21.15.82:0/1500792133 wait complete. 2020-04-02T23:47:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.816+0000 7f1000529700 1 Processor -- start 2020-04-02T23:47:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.816+0000 7f1000529700 1 -- start start 2020-04-02T23:47:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f1000529700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ff805c3a0 0x7f0ff80a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f1000529700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f1000529700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8149870 con 0x7f0ff805f730 2020-04-02T23:47:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f1000529700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80a1190 con 0x7f0ff805c3a0 2020-04-02T23:47:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f1000529700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80a8c80 con 0x7f0ff8140970 2020-04-02T23:47:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffeac6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffdac4700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0ff805f730 0x7f0ff809f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58676/0 (socket says 172.21.15.82:58676) 2020-04-02T23:47:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffdac4700 1 -- 172.21.15.82:0/2511665783 learned_addr learned my addr 172.21.15.82:0/2511665783 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffe2c5700 1 --2- 172.21.15.82:0/2511665783 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805c3a0 0x7f0ff80a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171720454 0 0) 0x7f0ff8149870 con 0x7f0ff805f730 2020-04-02T23:47:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd8002fe0 con 0x7f0ff805f730 2020-04-02T23:47:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffeac6700 1 -- 172.21.15.82:0/2511665783 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805c3a0 msgr2=0x7f0ff80a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805c3a0 0x7f0ff80a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffeac6700 1 -- 172.21.15.82:0/2511665783 >> v1:172.21.15.50:6789/0 conn(0x7f0ff805f730 legacy=0x7f0ff809f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffeac6700 1 -- 172.21.15.82:0/2511665783 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80a2700 con 0x7f0ff8140970 2020-04-02T23:47:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffe2c5700 1 --2- 172.21.15.82:0/2511665783 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805c3a0 0x7f0ff80a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.817+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fec010210 con 0x7f0ff8140970 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80a2460 con 0x7f0ff8140970 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec011c00 con 0x7f0ff8140970 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fec011e20 con 0x7f0ff8140970 2020-04-02T23:47:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff809f9b0 con 0x7f0ff8140970 2020-04-02T23:47:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.818+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0fec0056c0 con 0x7f0ff8140970 2020-04-02T23:47:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff8056c50 con 0x7f0ff8140970 2020-04-02T23:47:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0feb7fe700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 0x7f0fd804fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0fec061320 con 0x7f0ff8140970 2020-04-02T23:47:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0ffe2c5700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 0x7f0fd804fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:16.831 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0ffe2c5700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 0x7f0fd804fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ff805eea0 tx=0x7f0ff0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.831 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0ffe2c5700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 0x7f0fd804fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ff805eea0 tx=0x7f0ff0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.831 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.819+0000 7f0ffe2c5700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 0x7f0fd804fdd0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f0ff805eea0 tx=0x7f0ff0001720).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:16.831 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.823+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.831 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.823+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f0fec03ca80 con 0x7f0ff8140970 2020-04-02T23:47:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.962+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ff80aaa40 con 0x7f0ff8140970 2020-04-02T23:47:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.963+0000 7f0ffeac6700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.963+0000 7f0feb7fe700 1 -- 172.21.15.82:0/2511665783 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f0fec0400a0 con 0x7f0ff8140970 2020-04-02T23:47:16.965 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:16.966 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 msgr2=0x7f0fd804fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 0x7f0fd804fdd0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f0ff805eea0 tx=0x7f0ff0001720).stop 2020-04-02T23:47:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 msgr2=0x7f0ff8149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f0fec002f30 tx=0x7f0fec007a40).stop 2020-04-02T23:47:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 shutdown_connections 2020-04-02T23:47:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f0fd804d910 0x7f0fd804fdd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 --2- 172.21.15.82:0/2511665783 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ff8140970 0x7f0ff8149ea0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 --2- 172.21.15.82:0/2511665783 >> v2:172.21.15.50:3300/0 conn(0x7f0ff805c3a0 0x7f0ff80a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 >> 172.21.15.82:0/2511665783 conn(0x7f0ff80aa630 msgr2=0x7f0ff80abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 shutdown_connections 2020-04-02T23:47:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:16.964+0000 7f1000529700 1 -- 172.21.15.82:0/2511665783 wait complete. 2020-04-02T23:47:16.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:42.430184+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:55.708328+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:58.921423+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:01.321018+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:47:16.977 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:16.991 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:47:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.136+0000 7f84901b2700 1 Processor -- start 2020-04-02T23:47:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.136+0000 7f84901b2700 1 -- start start 2020-04-02T23:47:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f84901b2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84880658e0 0x7f84880aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f84901b2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8488138d90 0x7f8488139200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f84901b2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84880aabc0 con 0x7f8488065cc0 2020-04-02T23:47:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f84901b2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8488133470 con 0x7f84880658e0 2020-04-02T23:47:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f84901b2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848809f3c0 con 0x7f8488138d90 2020-04-02T23:47:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f848d74d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8488065cc0 0x7f848805c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54712/0 (socket says 172.21.15.82:54712) 2020-04-02T23:47:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f848d74d700 1 -- 172.21.15.82:0/1882879426 learned_addr learned my addr 172.21.15.82:0/1882879426 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f848e74f700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8488138d90 0x7f8488139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f848df4e700 1 --2- 172.21.15.82:0/1882879426 >> v2:172.21.15.50:3300/0 conn(0x7f84880658e0 0x7f84880aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407229470 0 0) 0x7f84840010d0 con 0x7f8488065cc0 2020-04-02T23:47:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.137+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470003230 con 0x7f8488065cc0 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2284721532 0 0) 0x7f8470003230 con 0x7f8488065cc0 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8488138d90 msgr2=0x7f8488139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8488138d90 0x7f8488139200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 >> v2:172.21.15.50:3300/0 conn(0x7f84880658e0 msgr2=0x7f84880aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 --2- 172.21.15.82:0/1882879426 >> v2:172.21.15.50:3300/0 conn(0x7f84880658e0 0x7f84880aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848809f660 con 0x7f8488065cc0 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f8484001860 con 0x7f8488065cc0 2020-04-02T23:47:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 >> v1:172.21.15.82:6789/0 conn(0x7f8488065cc0 legacy=0x7f848805c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8470003720 0x7f8470003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8470004aa0 0x7f8470004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488133470 con 0x7f8470003720 2020-04-02T23:47:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848809f3c0 con 0x7f8470004060 2020-04-02T23:47:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847000b860 con 0x7f8470004aa0 2020-04-02T23:47:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848e74f700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8488138d90 0x7f8488139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848df4e700 1 --2- 172.21.15.82:0/1882879426 >> v2:172.21.15.50:3300/0 conn(0x7f84880658e0 0x7f84880aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848df4e700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8470003720 0x7f8470003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848e74f700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8470004aa0 0x7f8470004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 -- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8470004aa0 msgr2=0x7f8470004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8470004aa0 0x7f8470004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 -- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8470003720 msgr2=0x7f8470003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8470003720 0x7f8470003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 -- 172.21.15.82:0/1882879426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470003230 con 0x7f8470004060 2020-04-02T23:47:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848df4e700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8470003720 0x7f8470003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8484001570 tx=0x7f848400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8484001570 tx=0x7f848400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f8484001570 tx=0x7f848400c520).ready entity=mon.1 client_cookie=ad812210bbc5096e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f8484001570 tx=0x7f848400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84840059c0 con 0x7f8470004060 2020-04-02T23:47:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f8484001570 tx=0x7f848400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8484005b20 con 0x7f8470004060 2020-04-02T23:47:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848d74d700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f8484001570 tx=0x7f848400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848cf4c700 1 -- 172.21.15.82:0/1882879426 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8484010160 con 0x7f8470004060 2020-04-02T23:47:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f84901b2700 1 -- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 msgr2=0x7f8470004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f84901b2700 1 --2- 172.21.15.82:0/1882879426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8470004060 0x7f8470004530 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f8484001570 tx=0x7f848400c520).stop 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.138+0000 7f848e74f700 1 -- 172.21.15.82:0/1882879426 reap_dead start 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.139+0000 7f84901b2700 1 -- 172.21.15.82:0/1882879426 shutdown_connections 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.139+0000 7f84901b2700 1 -- 172.21.15.82:0/1882879426 >> 172.21.15.82:0/1882879426 conn(0x7f84880af2e0 msgr2=0x7f84880af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.139+0000 7f84901b2700 1 -- 172.21.15.82:0/1882879426 shutdown_connections 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.139+0000 7f84901b2700 1 -- 172.21.15.82:0/1882879426 wait complete. 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f84901b2700 1 Processor -- start 2020-04-02T23:47:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f84901b2700 1 -- start start 2020-04-02T23:47:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f84901b2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84880a3990 0x7f84880a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f84901b2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f84880a90a0 0x7f8488151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f84901b2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84880a5820 con 0x7f84880a5440 2020-04-02T23:47:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f84901b2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84880a3f10 con 0x7f84880a3990 2020-04-02T23:47:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f84901b2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8488135b90 con 0x7f84880a90a0 2020-04-02T23:47:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.140+0000 7f848e74f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f84880a90a0 0x7f8488151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f84880a90a0 0x7f8488151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54676/0 (socket says 172.21.15.82:54676) 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 -- 172.21.15.82:0/2202181524 learned_addr learned my addr 172.21.15.82:0/2202181524 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848d74d700 1 --2- 172.21.15.82:0/2202181524 >> v2:172.21.15.50:3300/0 conn(0x7f84880a3990 0x7f84880a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 -- 172.21.15.82:0/2202181524 >> v2:172.21.15.50:3300/0 conn(0x7f84880a3990 msgr2=0x7f84880a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> v2:172.21.15.50:3300/0 conn(0x7f84880a3990 0x7f84880a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 -- 172.21.15.82:0/2202181524 >> v1:172.21.15.50:6789/0 conn(0x7f84880a5440 legacy=0x7f84881467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 -- 172.21.15.82:0/2202181524 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488135d80 con 0x7f84880a90a0 2020-04-02T23:47:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> v2:172.21.15.82:3300/0 conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> v2:172.21.15.82:3300/0 conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f8476ffd700 1 -- 172.21.15.82:0/2202181524 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84800088d0 con 0x7f84880a90a0 2020-04-02T23:47:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f8476ffd700 1 -- 172.21.15.82:0/2202181524 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480008a30 con 0x7f84880a90a0 2020-04-02T23:47:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f8476ffd700 1 -- 172.21.15.82:0/2202181524 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8480008d90 con 0x7f84880a90a0 2020-04-02T23:47:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488136020 con 0x7f84880a90a0 2020-04-02T23:47:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.141+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8488136970 con 0x7f84880a90a0 2020-04-02T23:47:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.142+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.142+0000 7f8476ffd700 1 -- 172.21.15.82:0/2202181524 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f848000b250 con 0x7f84880a90a0 2020-04-02T23:47:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.142+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.142+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8488136680 con 0x7f84880a90a0 2020-04-02T23:47:17.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.142+0000 7f8476ffd700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 0x7f846804fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.142+0000 7f8476ffd700 1 -- 172.21.15.82:0/2202181524 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8480061210 con 0x7f84880a90a0 2020-04-02T23:47:17.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.142+0000 7f848df4e700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 0x7f846804fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.143+0000 7f848df4e700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 0x7f846804fb90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84880a5b30 tx=0x7f84780079b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.143+0000 7f848df4e700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 0x7f846804fb90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84880a5b30 tx=0x7f84780079b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.143+0000 7f848df4e700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 0x7f846804fb90 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f84880a5b30 tx=0x7f84780079b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.146+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.146+0000 7f8476ffd700 1 -- 172.21.15.82:0/2202181524 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f848003c8b0 con 0x7f84880a90a0 2020-04-02T23:47:17.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.283+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f84881361b0 con 0x7f84880a90a0 2020-04-02T23:47:17.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.284+0000 7f848e74f700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.284+0000 7f8476ffd700 1 -- 172.21.15.82:0/2202181524 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f848003fed0 con 0x7f84880a90a0 2020-04-02T23:47:17.286 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2020-04-02T23:47:17.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 msgr2=0x7f846804fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 0x7f846804fb90 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f84880a5b30 tx=0x7f84780079b0).stop 2020-04-02T23:47:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 msgr2=0x7f8488151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f84881363a0 tx=0x7f8480010dd0).stop 2020-04-02T23:47:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 shutdown_connections 2020-04-02T23:47:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f846804d6d0 0x7f846804fb90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 --2- 172.21.15.82:0/2202181524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84880a90a0 0x7f8488151160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 --2- 172.21.15.82:0/2202181524 >> v2:172.21.15.50:3300/0 conn(0x7f84880a3990 0x7f84880a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 >> 172.21.15.82:0/2202181524 conn(0x7f84880af2e0 msgr2=0x7f8488068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 shutdown_connections 2020-04-02T23:47:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.285+0000 7f84901b2700 1 -- 172.21.15.82:0/2202181524 wait complete. 2020-04-02T23:47:17.297 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:17.310 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:47:17.457 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.455+0000 7fbb39e46700 1 Processor -- start 2020-04-02T23:47:17.457 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.455+0000 7fbb39e46700 1 -- start start 2020-04-02T23:47:17.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb39e46700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb340aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb39e46700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb341391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb39e46700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb340aabc0 con 0x7fbb34065cc0 2020-04-02T23:47:17.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb39e46700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb34133470 con 0x7fbb340658e0 2020-04-02T23:47:17.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb39e46700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3409f3c0 con 0x7fbb34138d90 2020-04-02T23:47:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb341391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb341391c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54680/0 (socket says 172.21.15.82:54680) 2020-04-02T23:47:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 -- 172.21.15.82:0/1660679591 learned_addr learned my addr 172.21.15.82:0/1660679591 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb337fe700 1 --2- 172.21.15.82:0/1660679591 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb340aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 -- 172.21.15.82:0/1660679591 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 msgr2=0x7fbb340aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- 172.21.15.82:0/1660679591 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb340aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 -- 172.21.15.82:0/1660679591 >> v1:172.21.15.50:6789/0 conn(0x7fbb34065cc0 legacy=0x7fbb3405c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 -- 172.21.15.82:0/1660679591 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3409f660 con 0x7fbb34138d90 2020-04-02T23:47:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb337fe700 1 --2- 172.21.15.82:0/1660679591 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb340aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- 172.21.15.82:0/1660679591 >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb341391c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- 172.21.15.82:0/1660679591 >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb341391c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- 172.21.15.82:0/1660679591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb341391c0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).ready entity=mon.1 client_cookie=b4013de32b09d272 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- 172.21.15.82:0/1660679591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb341391c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- 172.21.15.82:0/1660679591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb341391c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb327fc700 1 -- 172.21.15.82:0/1660679591 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2c00a160 con 0x7fbb34138d90 2020-04-02T23:47:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.456+0000 7fbb33fff700 1 --2- 172.21.15.82:0/1660679591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb341391c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb327fc700 1 -- 172.21.15.82:0/1660679591 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00a2c0 con 0x7fbb34138d90 2020-04-02T23:47:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb327fc700 1 -- 172.21.15.82:0/1660679591 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2c00a6a0 con 0x7fbb34138d90 2020-04-02T23:47:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 -- 172.21.15.82:0/1660679591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 msgr2=0x7fbb341391c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 --2- 172.21.15.82:0/1660679591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb341391c0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).stop 2020-04-02T23:47:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 -- 172.21.15.82:0/1660679591 shutdown_connections 2020-04-02T23:47:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 --2- 172.21.15.82:0/1660679591 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb340aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 --2- 172.21.15.82:0/1660679591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb341391c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 -- 172.21.15.82:0/1660679591 >> 172.21.15.82:0/1660679591 conn(0x7fbb340af2e0 msgr2=0x7fbb340af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 -- 172.21.15.82:0/1660679591 shutdown_connections 2020-04-02T23:47:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.457+0000 7fbb39e46700 1 -- 172.21.15.82:0/1660679591 wait complete. 2020-04-02T23:47:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.458+0000 7fbb39e46700 1 Processor -- start 2020-04-02T23:47:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.458+0000 7fbb39e46700 1 -- start start 2020-04-02T23:47:17.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb39e46700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb341464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb39e46700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb340a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb39e46700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb340a2370 con 0x7fbb34065cc0 2020-04-02T23:47:17.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb39e46700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb34146930 con 0x7fbb340658e0 2020-04-02T23:47:17.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb39e46700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb340a3c40 con 0x7fbb34138d90 2020-04-02T23:47:17.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb340a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb32ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbb34065cc0 0x7fbb340a8c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54738/0 (socket says 172.21.15.82:54738) 2020-04-02T23:47:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb32ffd700 1 -- 172.21.15.82:0/4003377212 learned_addr learned my addr 172.21.15.82:0/4003377212 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb337fe700 1 --2- 172.21.15.82:0/4003377212 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb341464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 -- 172.21.15.82:0/4003377212 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 msgr2=0x7fbb341464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb341464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 -- 172.21.15.82:0/4003377212 >> v1:172.21.15.82:6789/0 conn(0x7fbb34065cc0 legacy=0x7fbb340a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 -- 172.21.15.82:0/4003377212 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb340a2610 con 0x7fbb34138d90 2020-04-02T23:47:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412865467 0 0) 0x7fbb340a2370 con 0x7fbb34065cc0 2020-04-02T23:47:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> v2:172.21.15.82:3300/0 conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2c005c30 con 0x7fbb34138d90 2020-04-02T23:47:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c005d90 con 0x7fbb34138d90 2020-04-02T23:47:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb34136940 con 0x7fbb34138d90 2020-04-02T23:47:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2c00f760 con 0x7fbb34138d90 2020-04-02T23:47:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.459+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb340a5580 con 0x7fbb34138d90 2020-04-02T23:47:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.460+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.460+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb34056c50 con 0x7fbb34138d90 2020-04-02T23:47:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.460+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbb2c00f9d0 con 0x7fbb34138d90 2020-04-02T23:47:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.460+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.461+0000 7fbb30ff9700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 0x7fbb1404f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.461+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbb2c061e90 con 0x7fbb34138d90 2020-04-02T23:47:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.461+0000 7fbb337fe700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 0x7fbb1404f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.461+0000 7fbb337fe700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 0x7fbb1404f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb24002f30 tx=0x7fbb24008e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.461+0000 7fbb337fe700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 0x7fbb1404f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb24002f30 tx=0x7fbb24008e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.461+0000 7fbb337fe700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 0x7fbb1404f920 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fbb24002f30 tx=0x7fbb24008e50).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.464+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.464+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fbb2c03d6b0 con 0x7fbb34138d90 2020-04-02T23:47:17.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.601+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb340ab5c0 con 0x7fbb34138d90 2020-04-02T23:47:17.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.601+0000 7fbb33fff700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.601+0000 7fbb30ff9700 1 -- 172.21.15.82:0/4003377212 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb2c040cd0 con 0x7fbb34138d90 2020-04-02T23:47:17.604 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:17.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 msgr2=0x7fbb1404f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 0x7fbb1404f920 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fbb24002f30 tx=0x7fbb24008e50).stop 2020-04-02T23:47:17.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 msgr2=0x7fbb340a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fbb2c0032b0 tx=0x7fbb2c007dc0).stop 2020-04-02T23:47:17.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 shutdown_connections 2020-04-02T23:47:17.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb34138d90 0x7fbb340a37e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 --2- 172.21.15.82:0/4003377212 >> v2:172.21.15.50:3300/0 conn(0x7fbb340658e0 0x7fbb341464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 --2- 172.21.15.82:0/4003377212 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb1404d460 0x7fbb1404f920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 >> 172.21.15.82:0/4003377212 conn(0x7fbb340af2e0 msgr2=0x7fbb34068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 shutdown_connections 2020-04-02T23:47:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.602+0000 7fbb39e46700 1 -- 172.21.15.82:0/4003377212 wait complete. 2020-04-02T23:47:17.615 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:17.628 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:47:17.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.774+0000 7f42b23ac700 1 Processor -- start 2020-04-02T23:47:17.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.774+0000 7f42b23ac700 1 -- start start 2020-04-02T23:47:17.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b23ac700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42ac0a6970 0x7f42ac0a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.782 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b23ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42ac135610 0x7f42ac135a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b23ac700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac0a3dd0 con 0x7f42ac135ed0 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b23ac700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac0a2e60 con 0x7f42ac0a6970 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b23ac700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac0a22c0 con 0x7f42ac135610 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42ac0a6970 0x7f42ac0a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b1bab700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f42ac135ed0 0x7f42ac138bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54748/0 (socket says 172.21.15.82:54748) 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b1bab700 1 -- 172.21.15.82:0/301824482 learned_addr learned my addr 172.21.15.82:0/301824482 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42ac135610 0x7f42ac135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.783 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 -- 172.21.15.82:0/301824482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42ac135610 msgr2=0x7f42ac135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:17.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42ac135610 0x7f42ac135a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 -- 172.21.15.82:0/301824482 >> v1:172.21.15.82:6789/0 conn(0x7f42ac135ed0 legacy=0x7f42ac138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.784 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f429bfff700 1 -- 172.21.15.82:0/301824482 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562499853 0 0) 0x7f42ac0a3dd0 con 0x7f42ac135ed0 2020-04-02T23:47:17.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 -- 172.21.15.82:0/301824482 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac0a2560 con 0x7f42ac0a6970 2020-04-02T23:47:17.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42ac135610 0x7f42ac135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:17.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 --2- 172.21.15.82:0/301824482 >> v2:172.21.15.82:3300/0 conn(0x7f42ac0a6970 0x7f42ac0a2a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f429c002f30 tx=0x7f429c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.785 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 --2- 172.21.15.82:0/301824482 >> v2:172.21.15.82:3300/0 conn(0x7f42ac0a6970 0x7f42ac0a2a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f429c002f30 tx=0x7f429c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac0a6970 0x7f42ac0a2a00 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).ready entity=mon.1 client_cookie=53e9a42250887625 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f42b13aa700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac0a6970 0x7f42ac0a2a00 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.775+0000 7f429bfff700 1 -- 172.21.15.82:0/301824482 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f429c011470 con 0x7f42ac0a6970 2020-04-02T23:47:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b13aa700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac0a6970 0x7f42ac0a2a00 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f429bfff700 1 -- 172.21.15.82:0/301824482 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c0115d0 con 0x7f42ac0a6970 2020-04-02T23:47:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b13aa700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac0a6970 0x7f42ac0a2a00 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f429bfff700 1 -- 172.21.15.82:0/301824482 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f429c0119b0 con 0x7f42ac0a6970 2020-04-02T23:47:17.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 -- 172.21.15.82:0/301824482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac0a6970 msgr2=0x7f42ac0a2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac0a6970 0x7f42ac0a2a00 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).stop 2020-04-02T23:47:17.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 -- 172.21.15.82:0/301824482 shutdown_connections 2020-04-02T23:47:17.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac0a6970 0x7f42ac0a2a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 --2- 172.21.15.82:0/301824482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42ac135610 0x7f42ac135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 -- 172.21.15.82:0/301824482 >> 172.21.15.82:0/301824482 conn(0x7f42ac09de60 msgr2=0x7f42ac09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.787 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 -- 172.21.15.82:0/301824482 shutdown_connections 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.776+0000 7f42b23ac700 1 -- 172.21.15.82:0/301824482 wait complete. 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.777+0000 7f42b23ac700 1 Processor -- start 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.777+0000 7f42b23ac700 1 -- start start 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.777+0000 7f42b23ac700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42ac0a6970 0x7f42ac131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.777+0000 7f42b23ac700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42ac135610 0x7f42ac1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b23ac700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac136fa0 con 0x7f42ac135ed0 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b23ac700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac1373d0 con 0x7f42ac0a6970 2020-04-02T23:47:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b23ac700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac1375c0 con 0x7f42ac135610 2020-04-02T23:47:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42ac135610 0x7f42ac1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b1bab700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f42ac135ed0 0x7f42ac129f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54754/0 (socket says 172.21.15.82:54754) 2020-04-02T23:47:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b1bab700 1 -- 172.21.15.82:0/1361245166 learned_addr learned my addr 172.21.15.82:0/1361245166 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b13aa700 1 --2- 172.21.15.82:0/1361245166 >> v2:172.21.15.50:3300/0 conn(0x7f42ac0a6970 0x7f42ac131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192747075 0 0) 0x7f42ac136fa0 con 0x7f42ac135ed0 2020-04-02T23:47:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 -- 172.21.15.82:0/1361245166 >> v2:172.21.15.50:3300/0 conn(0x7f42ac0a6970 msgr2=0x7f42ac131d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> v2:172.21.15.50:3300/0 conn(0x7f42ac0a6970 0x7f42ac131d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 -- 172.21.15.82:0/1361245166 >> v1:172.21.15.82:6789/0 conn(0x7f42ac135ed0 legacy=0x7f42ac129f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 -- 172.21.15.82:0/1361245166 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac137860 con 0x7f42ac135610 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b13aa700 1 --2- 172.21.15.82:0/1361245166 >> v2:172.21.15.50:3300/0 conn(0x7f42ac0a6970 0x7f42ac131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> v2:172.21.15.82:3300/0 conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> v2:172.21.15.82:3300/0 conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a80091a0 con 0x7f42ac135610 2020-04-02T23:47:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a8009300 con 0x7f42ac135610 2020-04-02T23:47:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a80096a0 con 0x7f42ac135610 2020-04-02T23:47:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac137b00 con 0x7f42ac135610 2020-04-02T23:47:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.778+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac12c9d0 con 0x7f42ac135610 2020-04-02T23:47:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.779+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.779+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac132740 con 0x7f42ac135610 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.779+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f42a8007170 con 0x7f42ac135610 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.779+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.779+0000 7f429a7fc700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 0x7f428c04f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.780+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f42a8060bd0 con 0x7f42ac135610 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.780+0000 7f42b13aa700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 0x7f428c04f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.780+0000 7f42b13aa700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 0x7f428c04f860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.780+0000 7f42b13aa700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 0x7f428c04f860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.793 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.780+0000 7f42b13aa700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 0x7f428c04f860 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.793 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.783+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.793 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.783+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f42a803c330 con 0x7f42ac135610 2020-04-02T23:47:17.922 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.920+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42ac056c50 con 0x7f42ac135610 2020-04-02T23:47:17.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.920+0000 7f42b0ba9700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.920+0000 7f429a7fc700 1 -- 172.21.15.82:0/1361245166 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f42a803f950 con 0x7f42ac135610 2020-04-02T23:47:17.923 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 msgr2=0x7f428c04f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 0x7f428c04f860 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f429c002f30 tx=0x7f429c007a40).stop 2020-04-02T23:47:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 msgr2=0x7f42ac1321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f42a8002f30 tx=0x7f42a8010af0).stop 2020-04-02T23:47:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 shutdown_connections 2020-04-02T23:47:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f428c04d3a0 0x7f428c04f860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 --2- 172.21.15.82:0/1361245166 >> v2:172.21.15.50:3300/0 conn(0x7f42ac0a6970 0x7f42ac131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 --2- 172.21.15.82:0/1361245166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac135610 0x7f42ac1321f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 >> 172.21.15.82:0/1361245166 conn(0x7f42ac09de60 msgr2=0x7f42ac068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 shutdown_connections 2020-04-02T23:47:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:17.922+0000 7f42b23ac700 1 -- 172.21.15.82:0/1361245166 wait complete. 2020-04-02T23:47:17.936 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:17.957 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:47:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.103+0000 7f4ef620a700 1 Processor -- start 2020-04-02T23:47:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.103+0000 7f4ef620a700 1 -- start start 2020-04-02T23:47:18.113 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4ef620a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:18.113 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4ef620a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a6e70 0x7f4ef00a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4ef620a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00a3960 con 0x7f4ef0135ff0 2020-04-02T23:47:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4ef620a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef00a73f0 con 0x7f4ef00a6e70 2020-04-02T23:47:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4ef620a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00a6a40 con 0x7f4ef00a8410 2020-04-02T23:47:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eeffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4ef0135ff0 0x7f4ef0138f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54762/0 (socket says 172.21.15.82:54762) 2020-04-02T23:47:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eeffff700 1 -- 172.21.15.82:0/3884811661 learned_addr learned my addr 172.21.15.82:0/3884811661 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eeeffd700 1 --2- 172.21.15.82:0/3884811661 >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a6e70 0x7f4ef00a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eee7fc700 1 -- 172.21.15.82:0/3884811661 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558695734 0 0) 0x7f4ef00a3960 con 0x7f4ef0135ff0 2020-04-02T23:47:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eee7fc700 1 -- 172.21.15.82:0/3884811661 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc003230 con 0x7f4ef0135ff0 2020-04-02T23:47:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eef7fe700 1 -- 172.21.15.82:0/3884811661 >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a6e70 msgr2=0x7f4ef00a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eee7fc700 1 -- 172.21.15.82:0/3884811661 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2775617776 0 0) 0x7f4edc003230 con 0x7f4ef0135ff0 2020-04-02T23:47:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a6e70 0x7f4ef00a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eef7fe700 1 -- 172.21.15.82:0/3884811661 >> v1:172.21.15.82:6789/0 conn(0x7f4ef0135ff0 legacy=0x7f4ef0138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eef7fe700 1 -- 172.21.15.82:0/3884811661 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00a7690 con 0x7f4ef00a8410 2020-04-02T23:47:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.104+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ee8001870 tx=0x7f4ee0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ee8001870 tx=0x7f4ee0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f4ee8001870 tx=0x7f4ee0007dc0).ready entity=mon.2 client_cookie=8db09b53d48b3f2a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f4ee8001870 tx=0x7f4ee0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eee7fc700 1 -- 172.21.15.82:0/3884811661 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee80016d0 con 0x7f4ef00a8410 2020-04-02T23:47:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f4ee8001870 tx=0x7f4ee0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f4ee8001870 tx=0x7f4ee0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eee7fc700 1 -- 172.21.15.82:0/3884811661 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee0010a10 con 0x7f4ef00a8410 2020-04-02T23:47:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4eee7fc700 1 -- 172.21.15.82:0/3884811661 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee0010d70 con 0x7f4ef00a8410 2020-04-02T23:47:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 -- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 msgr2=0x7f4ef009f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f4ee8001870 tx=0x7f4ee0007dc0).stop 2020-04-02T23:47:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 -- 172.21.15.82:0/3884811661 shutdown_connections 2020-04-02T23:47:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 --2- 172.21.15.82:0/3884811661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ef00a8410 0x7f4ef009f610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 --2- 172.21.15.82:0/3884811661 >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a6e70 0x7f4ef00a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 -- 172.21.15.82:0/3884811661 >> 172.21.15.82:0/3884811661 conn(0x7f4ef00ab970 msgr2=0x7f4ef00a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 -- 172.21.15.82:0/3884811661 shutdown_connections 2020-04-02T23:47:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.105+0000 7f4ef620a700 1 -- 172.21.15.82:0/3884811661 wait complete. 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.106+0000 7f4ef620a700 1 Processor -- start 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.106+0000 7f4ef620a700 1 -- start start 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4ef620a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a8410 0x7f4ef009d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4ef620a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef009c780 con 0x7f4ef0135ff0 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4ef620a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00a3450 con 0x7f4ef00a6e70 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4ef620a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef009c9b0 con 0x7f4ef00a8410 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eef7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4ef00a6e70 0x7f4ef00a5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54764/0 (socket says 172.21.15.82:54764) 2020-04-02T23:47:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eef7fe700 1 -- 172.21.15.82:0/1086716690 learned_addr learned my addr 172.21.15.82:0/1086716690 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672604911 0 0) 0x7f4ef00a3450 con 0x7f4ef00a6e70 2020-04-02T23:47:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed0002fe0 con 0x7f4ef00a6e70 2020-04-02T23:47:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eeeffd700 1 --2- 172.21.15.82:0/1086716690 >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a8410 0x7f4ef009d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 398477162 0 0) 0x7f4ed0002fe0 con 0x7f4ef00a6e70 2020-04-02T23:47:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ef00a3450 con 0x7f4ef00a6e70 2020-04-02T23:47:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f4ee0008940 con 0x7f4ef00a6e70 2020-04-02T23:47:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a8410 msgr2=0x7f4ef009d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 --2- 172.21.15.82:0/1086716690 >> v2:172.21.15.50:3300/0 conn(0x7f4ef00a8410 0x7f4ef009d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 >> v1:172.21.15.82:6789/0 conn(0x7f4ef00a6e70 legacy=0x7f4ef00a5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 >> v1:172.21.15.50:6789/0 conn(0x7f4ef0135ff0 legacy=0x7f4ef0065ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.107+0000 7f4eecff9700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ed00049b0 0x7f4ed0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed0003920 0x7f4ed0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef009c9b0 con 0x7f4ed0003920 2020-04-02T23:47:18.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00046b0 con 0x7f4ed0004200 2020-04-02T23:47:18.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed000bbb0 con 0x7f4ed00049b0 2020-04-02T23:47:18.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeeffd700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed0003920 0x7f4ed0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ed00049b0 0x7f4ed0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 -- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ed00049b0 msgr2=0x7f4ed0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ed00049b0 0x7f4ed0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 -- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed0003920 msgr2=0x7f4ed0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed0003920 0x7f4ed0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef009cc50 con 0x7f4ed0004200 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef01336c0 con 0x7f4ed0004200 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 -- 172.21.15.82:0/1086716690 reap_dead start 2020-04-02T23:47:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef00665e0 con 0x7f4ed0004200 2020-04-02T23:47:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee8013060 con 0x7f4ed0004200 2020-04-02T23:47:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800cc50 con 0x7f4ed0004200 2020-04-02T23:47:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.108+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee80044f0 con 0x7f4ed0004200 2020-04-02T23:47:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.109+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.109+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc003340 con 0x7f4ed0004200 2020-04-02T23:47:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.109+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4ee8004650 con 0x7f4ed0004200 2020-04-02T23:47:18.126 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.109+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.127 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.109+0000 7f4eecff9700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 0x7f4ed0053870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.109+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4ee80608f0 con 0x7f4ed0004200 2020-04-02T23:47:18.128 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.110+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 0x7f4ed0053870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.129 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.110+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 0x7f4ed0053870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ee0007e20 tx=0x7f4ee0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.130 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.110+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 0x7f4ed0053870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ee0007e20 tx=0x7f4ee0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.131 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.110+0000 7f4eef7fe700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 0x7f4ed0053870 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f4ee0007e20 tx=0x7f4ee0007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.113+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.132 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.113+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4ee803c050 con 0x7f4ed0004200 2020-04-02T23:47:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.249+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ecc002200 con 0x7f4ed0004200 2020-04-02T23:47:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.249+0000 7f4eeffff700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.249+0000 7f4eecff9700 1 -- 172.21.15.82:0/1086716690 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4ee803f670 con 0x7f4ed0004200 2020-04-02T23:47:18.251 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 msgr2=0x7f4ed0053870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 0x7f4ed0053870 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f4ee0007e20 tx=0x7f4ee0007dc0).stop 2020-04-02T23:47:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 msgr2=0x7f4ed000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f4ef009e850 tx=0x7f4ee8010c20).stop 2020-04-02T23:47:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 shutdown_connections 2020-04-02T23:47:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4ed00513b0 0x7f4ed0053870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 --2- 172.21.15.82:0/1086716690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed0004200 0x7f4ed000b750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 >> 172.21.15.82:0/1086716690 conn(0x7f4ef00ab970 msgr2=0x7f4ef00a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 shutdown_connections 2020-04-02T23:47:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:18.250+0000 7f4ef620a700 1 -- 172.21.15.82:0/1086716690 wait complete. 2020-04-02T23:47:18.263 INFO:tasks.mds_thrash:mds thrasher using random seed: 1585871238 2020-04-02T23:47:18.263 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:18.280 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.443+0000 7fd27902c700 1 Processor -- start 2020-04-02T23:47:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.443+0000 7fd27902c700 1 -- start start 2020-04-02T23:47:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27902c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27902c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd274067280 0x7fd27413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27902c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740a7ab0 con 0x7fd27409f1b0 2020-04-02T23:47:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27902c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2740a6e80 con 0x7fd274067280 2020-04-02T23:47:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27902c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd274066b40 con 0x7fd27405b390 2020-04-02T23:47:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd274067280 0x7fd27413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd272d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27359e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd27409f1b0 0x7fd27409f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36182/0 (socket says 172.21.15.50:36182) 2020-04-02T23:47:18.449 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27359e700 1 -- 172.21.15.50:0/590329602 learned_addr learned my addr 172.21.15.50:0/590329602 (peer_addr_for_me v1:172.21.15.50:0/0) 2020-04-02T23:47:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd272d9d700 1 -- 172.21.15.50:0/590329602 >> v2:172.21.15.50:3300/0 conn(0x7fd274067280 msgr2=0x7fd27413c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd272d9d700 1 --2- 172.21.15.50:0/590329602 >> v2:172.21.15.50:3300/0 conn(0x7fd274067280 0x7fd27413c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd272d9d700 1 -- 172.21.15.50:0/590329602 >> v1:172.21.15.50:6789/0 conn(0x7fd27409f1b0 legacy=0x7fd27409f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd272d9d700 1 -- 172.21.15.50:0/590329602 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740a25d0 con 0x7fd27405b390 2020-04-02T23:47:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd271d9b700 1 -- 172.21.15.50:0/590329602 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623319778 0 0) 0x7fd2740a7ab0 con 0x7fd27409f1b0 2020-04-02T23:47:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd27259c700 1 --2- 172.21.15.50:0/590329602 >> v2:172.21.15.50:3300/0 conn(0x7fd274067280 0x7fd27413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd272d9d700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd25c002f30 tx=0x7fd25c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.444+0000 7fd272d9d700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd25c002f30 tx=0x7fd25c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd272d9d700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fd25c002f30 tx=0x7fd25c007a40).ready entity=mon.2 client_cookie=dab25547f933efa1 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd272d9d700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fd25c002f30 tx=0x7fd25c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd271d9b700 1 -- 172.21.15.50:0/590329602 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25c008d00 con 0x7fd27405b390 2020-04-02T23:47:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd272d9d700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fd25c002f30 tx=0x7fd25c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd271d9b700 1 -- 172.21.15.50:0/590329602 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c008e60 con 0x7fd27405b390 2020-04-02T23:47:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd272d9d700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fd25c002f30 tx=0x7fd25c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 -- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 msgr2=0x7fd27413c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd271d9b700 1 -- 172.21.15.50:0/590329602 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25c011930 con 0x7fd27405b390 2020-04-02T23:47:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fd25c002f30 tx=0x7fd25c007a40).stop 2020-04-02T23:47:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 -- 172.21.15.50:0/590329602 shutdown_connections 2020-04-02T23:47:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 --2- 172.21.15.50:0/590329602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27405b390 0x7fd27413c380 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 --2- 172.21.15.50:0/590329602 >> v2:172.21.15.50:3300/0 conn(0x7fd274067280 0x7fd27413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 -- 172.21.15.50:0/590329602 >> 172.21.15.50:0/590329602 conn(0x7fd2740614c0 msgr2=0x7fd2740ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 -- 172.21.15.50:0/590329602 shutdown_connections 2020-04-02T23:47:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.445+0000 7fd27902c700 1 -- 172.21.15.50:0/590329602 wait complete. 2020-04-02T23:47:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.446+0000 7fd27902c700 1 Processor -- start 2020-04-02T23:47:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.446+0000 7fd27902c700 1 -- start start 2020-04-02T23:47:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27902c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd274067280 0x7fd2741367f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27902c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27902c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740a23a0 con 0x7fd27405b390 2020-04-02T23:47:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27902c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27413a660 con 0x7fd274067280 2020-04-02T23:47:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27902c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2741370b0 con 0x7fd27409f1b0 2020-04-02T23:47:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd272d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd27405b390 0x7fd27409c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36184/0 (socket says 172.21.15.50:36184) 2020-04-02T23:47:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd272d9d700 1 -- 172.21.15.50:0/3884405346 learned_addr learned my addr 172.21.15.50:0/3884405346 (peer_addr_for_me v1:172.21.15.50:0/0) 2020-04-02T23:47:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647427788 0 0) 0x7fd2740a23a0 con 0x7fd27405b390 2020-04-02T23:47:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd258002fe0 con 0x7fd27405b390 2020-04-02T23:47:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27259c700 1 --2- 172.21.15.50:0/3884405346 >> v2:172.21.15.82:3300/0 conn(0x7fd274067280 0x7fd2741367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 -- 172.21.15.50:0/3884405346 >> v2:172.21.15.82:3300/0 conn(0x7fd274067280 msgr2=0x7fd2741367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> v2:172.21.15.82:3300/0 conn(0x7fd274067280 0x7fd2741367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 -- 172.21.15.50:0/3884405346 >> v1:172.21.15.50:6789/0 conn(0x7fd27405b390 legacy=0x7fd27409c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 -- 172.21.15.50:0/3884405346 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740a56c0 con 0x7fd27409f1b0 2020-04-02T23:47:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27259c700 1 --2- 172.21.15.50:0/3884405346 >> v2:172.21.15.82:3300/0 conn(0x7fd274067280 0x7fd2741367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.447+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd26c005e30 con 0x7fd27409f1b0 2020-04-02T23:47:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c012470 con 0x7fd27409f1b0 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27413a3c0 con 0x7fd27409f1b0 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd26c012890 con 0x7fd27409f1b0 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27413a0f0 con 0x7fd27409f1b0 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.448+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.449+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd26c012b00 con 0x7fd27409f1b0 2020-04-02T23:47:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.449+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.449+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27409deb0 con 0x7fd27409f1b0 2020-04-02T23:47:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.449+0000 7fd26bfff700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 0x7fd25804fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.449+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd26c0613f0 con 0x7fd27409f1b0 2020-04-02T23:47:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.449+0000 7fd272d9d700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 0x7fd25804fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.450+0000 7fd272d9d700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 0x7fd25804fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2740aa520 tx=0x7fd25c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.450+0000 7fd272d9d700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 0x7fd25804fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2740aa520 tx=0x7fd25c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.450+0000 7fd272d9d700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 0x7fd25804fdb0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fd2740aa520 tx=0x7fd25c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.452+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.452+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd26c03caf0 con 0x7fd27409f1b0 2020-04-02T23:47:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.599+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd274056c50 con 0x7fd27409f1b0 2020-04-02T23:47:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.600+0000 7fd27359e700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.600+0000 7fd26bfff700 1 -- 172.21.15.50:0/3884405346 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd26c040110 con 0x7fd27409f1b0 2020-04-02T23:47:18.604 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:47:18.604 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 msgr2=0x7fd25804fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 0x7fd25804fdb0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fd2740aa520 tx=0x7fd25c007a40).stop 2020-04-02T23:47:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 msgr2=0x7fd274136c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fd26c000f00 tx=0x7fd26c010be0).stop 2020-04-02T23:47:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 shutdown_connections 2020-04-02T23:47:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd25804d8f0 0x7fd25804fdb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 --2- 172.21.15.50:0/3884405346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd27409f1b0 0x7fd274136c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 --2- 172.21.15.50:0/3884405346 >> v2:172.21.15.82:3300/0 conn(0x7fd274067280 0x7fd2741367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 >> 172.21.15.50:0/3884405346 conn(0x7fd2740614c0 msgr2=0x7fd2740aada0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 shutdown_connections 2020-04-02T23:47:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.602+0000 7fd27902c700 1 -- 172.21.15.50:0/3884405346 wait complete. 2020-04-02T23:47:18.617 INFO:tasks.mds_thrash.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:42.430184+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:55.708328+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:58.921423+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:01.321018+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:47:18.618 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:18.632 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:47:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.786+0000 7f93512dd700 1 Processor -- start 2020-04-02T23:47:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.786+0000 7f93512dd700 1 -- start start 2020-04-02T23:47:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f93512dd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f934c05b390 0x7f934c0667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f93512dd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f93512dd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c05efb0 0x7f934c05f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f93512dd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0a7d30 con 0x7f934c05efb0 2020-04-02T23:47:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f93512dd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0a63a0 con 0x7f934c05b390 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f93512dd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a6640 con 0x7f934c13c820 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c05efb0 0x7f934c05f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c05efb0 0x7f934c05f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50726/0 (socket says 172.21.15.50:50726) 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:56562/0 (socket says 172.21.15.50:56562) 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934b7fe700 1 -- 172.21.15.50:0/1603121466 learned_addr learned my addr 172.21.15.50:0/1603121466 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934affd700 1 --2- 172.21.15.50:0/1603121466 >> v2:172.21.15.82:3300/0 conn(0x7f934c05b390 0x7f934c0667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 -- 172.21.15.50:0/1603121466 >> v2:172.21.15.82:3300/0 conn(0x7f934c05b390 msgr2=0x7f934c0667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> v2:172.21.15.82:3300/0 conn(0x7f934c05b390 0x7f934c0667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 -- 172.21.15.50:0/1603121466 >> v2:172.21.15.50:3300/0 conn(0x7f934c05efb0 msgr2=0x7f934c05f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> v2:172.21.15.50:3300/0 conn(0x7f934c05efb0 0x7f934c05f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 -- 172.21.15.50:0/1603121466 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c13c380 con 0x7f934c13c820 2020-04-02T23:47:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934b7fe700 1 --2- 172.21.15.50:0/1603121466 >> v2:172.21.15.50:3300/0 conn(0x7f934c05efb0 0x7f934c05f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f933c002f30 tx=0x7f934c060400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f933c002f30 tx=0x7f934c060400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f933c002f30 tx=0x7f934c060400).ready entity=mon.2 client_cookie=30c60f33730874b7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.787+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f933c002f30 tx=0x7f934c060400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f933c002f30 tx=0x7f934c060400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f9349ffb700 1 -- 172.21.15.50:0/1603121466 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933c0113c0 con 0x7f934c13c820 2020-04-02T23:47:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f934a7fc700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f933c002f30 tx=0x7f934c060400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f9349ffb700 1 -- 172.21.15.50:0/1603121466 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c011520 con 0x7f934c13c820 2020-04-02T23:47:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f9349ffb700 1 -- 172.21.15.50:0/1603121466 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933c0118c0 con 0x7f934c13c820 2020-04-02T23:47:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 -- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 msgr2=0x7f934c13cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f933c002f30 tx=0x7f934c060400).stop 2020-04-02T23:47:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 -- 172.21.15.50:0/1603121466 shutdown_connections 2020-04-02T23:47:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 --2- 172.21.15.50:0/1603121466 >> v2:172.21.15.50:3300/0 conn(0x7f934c05efb0 0x7f934c05f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 --2- 172.21.15.50:0/1603121466 >> v2:172.21.15.82:3300/0 conn(0x7f934c05b390 0x7f934c0667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 --2- 172.21.15.50:0/1603121466 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c13cca0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 -- 172.21.15.50:0/1603121466 >> 172.21.15.50:0/1603121466 conn(0x7f934c0a8260 msgr2=0x7f934c0a8670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 -- 172.21.15.50:0/1603121466 shutdown_connections 2020-04-02T23:47:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.788+0000 7f93512dd700 1 -- 172.21.15.50:0/1603121466 wait complete. 2020-04-02T23:47:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.789+0000 7f93512dd700 1 Processor -- start 2020-04-02T23:47:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.789+0000 7f93512dd700 1 -- start start 2020-04-02T23:47:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f93512dd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c05b390 0x7f934c0a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f93512dd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f93512dd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0a4430 con 0x7f934c05efb0 2020-04-02T23:47:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f93512dd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0a3750 con 0x7f934c05b390 2020-04-02T23:47:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f93512dd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a46d0 con 0x7f934c13c820 2020-04-02T23:47:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c05b390 0x7f934c0a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c05b390 0x7f934c0a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50732/0 (socket says 172.21.15.50:50732) 2020-04-02T23:47:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 -- 172.21.15.50:0/550248655 learned_addr learned my addr 172.21.15.50:0/550248655 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932237306 0 0) 0x7f934c0a4430 con 0x7f934c05efb0 2020-04-02T23:47:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 -- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 msgr2=0x7f934c139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 -- 172.21.15.50:0/550248655 >> v1:172.21.15.82:6789/0 conn(0x7f934c05efb0 legacy=0x7f934c1395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 -- 172.21.15.50:0/550248655 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0a4970 con 0x7f934c05b390 2020-04-02T23:47:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934b7fe700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> v2:172.21.15.50:3300/0 conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> v2:172.21.15.50:3300/0 conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9340012b50 con 0x7f934c05b390 2020-04-02T23:47:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c0a08f0 con 0x7f934c05b390 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340012cb0 con 0x7f934c05b390 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9340012e20 con 0x7f934c05b390 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.790+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c0a5520 con 0x7f934c05b390 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.791+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.791+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c0a4b00 con 0x7f934c05b390 2020-04-02T23:47:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.791+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9340007170 con 0x7f934c05b390 2020-04-02T23:47:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.791+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.792+0000 7f933bfff700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 0x7f932804f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.792+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9340061670 con 0x7f934c05b390 2020-04-02T23:47:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.792+0000 7f934a7fc700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 0x7f932804f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.792+0000 7f934a7fc700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 0x7f932804f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f933c000b80 tx=0x7f934c060400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.792+0000 7f934a7fc700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 0x7f932804f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f933c000b80 tx=0x7f934c060400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.792+0000 7f934a7fc700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 0x7f932804f9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f933c000b80 tx=0x7f934c060400).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.795+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.795+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f934003cd50 con 0x7f934c05b390 2020-04-02T23:47:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.944+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f934c056c50 con 0x7f934c05b390 2020-04-02T23:47:18.947 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.944+0000 7f934affd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:18.947 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.944+0000 7f933bfff700 1 -- 172.21.15.50:0/550248655 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9340040370 con 0x7f934c05b390 2020-04-02T23:47:18.947 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2020-04-02T23:47:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 msgr2=0x7f932804f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 0x7f932804f9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f933c000b80 tx=0x7f934c060400).stop 2020-04-02T23:47:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 msgr2=0x7f934c0a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f9340002f30 tx=0x7f9340010ce0).stop 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 shutdown_connections 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f934c13c820 0x7f934c139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c05b390 0x7f934c0a1440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 --2- 172.21.15.50:0/550248655 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f932804d530 0x7f932804f9f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 >> 172.21.15.50:0/550248655 conn(0x7f934c0a8260 msgr2=0x7f934c13bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 shutdown_connections 2020-04-02T23:47:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:18.946+0000 7f93512dd700 1 -- 172.21.15.50:0/550248655 wait complete. 2020-04-02T23:47:18.958 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:18.971 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:47:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.126+0000 7f9bced62700 1 Processor -- start 2020-04-02T23:47:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.126+0000 7f9bced62700 1 -- start start 2020-04-02T23:47:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bced62700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9bc80aa560 0x7f9bc813c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bced62700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bced62700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc80a9a00 con 0x7f9bc813cdc0 2020-04-02T23:47:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bced62700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc813c220 con 0x7f9bc80aa560 2020-04-02T23:47:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bced62700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc813c4c0 con 0x7f9bc805f4f0 2020-04-02T23:47:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bc7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9bc813cdc0 0x7f9bc80a8ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36208/0 (socket says 172.21.15.50:36208) 2020-04-02T23:47:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bc7fff700 1 -- 172.21.15.50:0/2155913496 learned_addr learned my addr 172.21.15.50:0/2155913496 (peer_addr_for_me v1:172.21.15.50:0/0) 2020-04-02T23:47:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bccafe700 1 --2- 172.21.15.50:0/2155913496 >> v2:172.21.15.82:3300/0 conn(0x7f9bc80aa560 0x7f9bc813c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bc77fe700 1 -- 172.21.15.50:0/2155913496 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335808638 0 0) 0x7f9bc80a9a00 con 0x7f9bc813cdc0 2020-04-02T23:47:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 -- 172.21.15.50:0/2155913496 >> v2:172.21.15.82:3300/0 conn(0x7f9bc80aa560 msgr2=0x7f9bc813c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- 172.21.15.50:0/2155913496 >> v2:172.21.15.82:3300/0 conn(0x7f9bc80aa560 0x7f9bc813c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 -- 172.21.15.50:0/2155913496 >> v1:172.21.15.50:6789/0 conn(0x7f9bc813cdc0 legacy=0x7f9bc80a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 -- 172.21.15.50:0/2155913496 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80aa940 con 0x7f9bc805f4f0 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bccafe700 1 --2- 172.21.15.50:0/2155913496 >> v2:172.21.15.82:3300/0 conn(0x7f9bc80aa560 0x7f9bc813c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).ready entity=mon.2 client_cookie=304985f294cc846d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bc77fe700 1 -- 172.21.15.50:0/2155913496 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb8011470 con 0x7f9bc805f4f0 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bc77fe700 1 -- 172.21.15.50:0/2155913496 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb80115d0 con 0x7f9bc805f4f0 2020-04-02T23:47:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bcd2ff700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bc77fe700 1 -- 172.21.15.50:0/2155913496 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb80119b0 con 0x7f9bc805f4f0 2020-04-02T23:47:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bced62700 1 -- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 msgr2=0x7f9bc805f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.127+0000 7f9bced62700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).stop 2020-04-02T23:47:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.128+0000 7f9bced62700 1 -- 172.21.15.50:0/2155913496 shutdown_connections 2020-04-02T23:47:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.128+0000 7f9bced62700 1 --2- 172.21.15.50:0/2155913496 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc805f4f0 0x7f9bc805f980 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.128+0000 7f9bced62700 1 --2- 172.21.15.50:0/2155913496 >> v2:172.21.15.82:3300/0 conn(0x7f9bc80aa560 0x7f9bc813c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.128+0000 7f9bced62700 1 -- 172.21.15.50:0/2155913496 >> 172.21.15.50:0/2155913496 conn(0x7f9bc80adc40 msgr2=0x7f9bc80a9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.128+0000 7f9bced62700 1 -- 172.21.15.50:0/2155913496 shutdown_connections 2020-04-02T23:47:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.128+0000 7f9bced62700 1 -- 172.21.15.50:0/2155913496 wait complete. 2020-04-02T23:47:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.129+0000 7f9bced62700 1 Processor -- start 2020-04-02T23:47:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.129+0000 7f9bced62700 1 -- start start 2020-04-02T23:47:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bced62700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bced62700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9bc813cdc0 0x7f9bc812da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bced62700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc80a1530 con 0x7f9bc805f4f0 2020-04-02T23:47:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bced62700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc8139f70 con 0x7f9bc813cdc0 2020-04-02T23:47:19.144 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bced62700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc813af90 con 0x7f9bc80aa560 2020-04-02T23:47:19.144 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.144 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bcd2ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9bc813cdc0 0x7f9bc812da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.144 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:56584/0 (socket says 172.21.15.50:56584) 2020-04-02T23:47:19.144 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 -- 172.21.15.50:0/3131121222 learned_addr learned my addr 172.21.15.50:0/3131121222 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 -- 172.21.15.50:0/3131121222 >> v2:172.21.15.50:3300/0 conn(0x7f9bc813cdc0 msgr2=0x7f9bc812da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> v2:172.21.15.50:3300/0 conn(0x7f9bc813cdc0 0x7f9bc812da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 -- 172.21.15.50:0/3131121222 >> v1:172.21.15.82:6789/0 conn(0x7f9bc805f4f0 legacy=0x7f9bc813a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 -- 172.21.15.50:0/3131121222 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80a66d0 con 0x7f9bc80aa560 2020-04-02T23:47:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc5ffb700 1 -- 172.21.15.50:0/3131121222 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bbc005ca0 con 0x7f9bc80aa560 2020-04-02T23:47:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc5ffb700 1 -- 172.21.15.50:0/3131121222 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc005e00 con 0x7f9bc80aa560 2020-04-02T23:47:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bc5ffb700 1 -- 172.21.15.50:0/3131121222 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bbc0062b0 con 0x7f9bc80aa560 2020-04-02T23:47:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc80a72d0 con 0x7f9bc80aa560 2020-04-02T23:47:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.130+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc80a1100 con 0x7f9bc80aa560 2020-04-02T23:47:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.131+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.131+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc8056c50 con 0x7f9bc80aa560 2020-04-02T23:47:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.131+0000 7f9bc5ffb700 1 -- 172.21.15.50:0/3131121222 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9bbc006410 con 0x7f9bc80aa560 2020-04-02T23:47:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.131+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.132+0000 7f9bc5ffb700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 0x7f9ba804f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.132+0000 7f9bc5ffb700 1 -- 172.21.15.50:0/3131121222 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9bbc060df0 con 0x7f9bc80aa560 2020-04-02T23:47:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.132+0000 7f9bccafe700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 0x7f9ba804f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.132+0000 7f9bccafe700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 0x7f9ba804f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bc8131950 tx=0x7f9bc0001550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.132+0000 7f9bccafe700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 0x7f9ba804f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bc8131950 tx=0x7f9bc0001550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.132+0000 7f9bccafe700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 0x7f9ba804f9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f9bc8131950 tx=0x7f9bc0001550).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.135+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.135+0000 7f9bc5ffb700 1 -- 172.21.15.50:0/3131121222 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9bbc03c550 con 0x7f9bc80aa560 2020-04-02T23:47:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.285+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9bc805d150 con 0x7f9bc80aa560 2020-04-02T23:47:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.285+0000 7f9bc7fff700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.285+0000 7f9bc5ffb700 1 -- 172.21.15.50:0/3131121222 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9bbc03fb70 con 0x7f9bc80aa560 2020-04-02T23:47:19.288 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2020-04-02T23:47:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 msgr2=0x7f9ba804f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 0x7f9ba804f9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f9bc8131950 tx=0x7f9bc0001550).stop 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 msgr2=0x7f9bc812d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f9bbc000b80 tx=0x7f9bbc010920).stop 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 shutdown_connections 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 --2- 172.21.15.50:0/3131121222 >> v2:172.21.15.50:3300/0 conn(0x7f9bc813cdc0 0x7f9bc812da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f9ba804d500 0x7f9ba804f9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 --2- 172.21.15.50:0/3131121222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bc80aa560 0x7f9bc812d5d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 >> 172.21.15.50:0/3131121222 conn(0x7f9bc80adc40 msgr2=0x7f9bc80abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 shutdown_connections 2020-04-02T23:47:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.287+0000 7f9bced62700 1 -- 172.21.15.50:0/3131121222 wait complete. 2020-04-02T23:47:19.299 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:19.312 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:47:19.469 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.467+0000 7fe9dada4700 1 Processor -- start 2020-04-02T23:47:19.469 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.467+0000 7fe9dada4700 1 -- start start 2020-04-02T23:47:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9dada4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9d405ffc0 0x7fe9d4067140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9dada4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9d409e540 0x7fe9d413c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9dada4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d40a7770 con 0x7fe9d40603a0 2020-04-02T23:47:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9dada4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d413c6d0 con 0x7fe9d405ffc0 2020-04-02T23:47:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9dada4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d4066a00 con 0x7fe9d409e540 2020-04-02T23:47:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9d405ffc0 0x7fe9d4067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9d405ffc0 0x7fe9d4067140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50760/0 (socket says 172.21.15.50:50760) 2020-04-02T23:47:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 -- 172.21.15.50:0/3957337202 learned_addr learned my addr 172.21.15.50:0/3957337202 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d9341700 1 --2- 172.21.15.50:0/3957337202 >> v2:172.21.15.82:3300/0 conn(0x7fe9d409e540 0x7fe9d413c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 -- 172.21.15.50:0/3957337202 >> v2:172.21.15.82:3300/0 conn(0x7fe9d409e540 msgr2=0x7fe9d413c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/3957337202 >> v2:172.21.15.82:3300/0 conn(0x7fe9d409e540 0x7fe9d413c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 -- 172.21.15.50:0/3957337202 >> v1:172.21.15.82:6789/0 conn(0x7fe9d40603a0 legacy=0x7fe9d40a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 -- 172.21.15.50:0/3957337202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4066ca0 con 0x7fe9d405ffc0 2020-04-02T23:47:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d9341700 1 --2- 172.21.15.50:0/3957337202 >> v2:172.21.15.82:3300/0 conn(0x7fe9d409e540 0x7fe9d413c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/3957337202 >> v2:172.21.15.50:3300/0 conn(0x7fe9d405ffc0 0x7fe9d4067140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/3957337202 >> v2:172.21.15.50:3300/0 conn(0x7fe9d405ffc0 0x7fe9d4067140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/3957337202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d405ffc0 0x7fe9d4067140 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).ready entity=mon.0 client_cookie=2ea90d4dfeadf91 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/3957337202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d405ffc0 0x7fe9d4067140 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/3957337202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d405ffc0 0x7fe9d4067140 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.468+0000 7fe9d37fe700 1 -- 172.21.15.50:0/3957337202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9cc00a160 con 0x7fe9d405ffc0 2020-04-02T23:47:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/3957337202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d405ffc0 0x7fe9d4067140 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9d37fe700 1 -- 172.21.15.50:0/3957337202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00a2c0 con 0x7fe9d405ffc0 2020-04-02T23:47:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9d37fe700 1 -- 172.21.15.50:0/3957337202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9cc00a6a0 con 0x7fe9d405ffc0 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 -- 172.21.15.50:0/3957337202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d405ffc0 msgr2=0x7fe9d4067140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 --2- 172.21.15.50:0/3957337202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d405ffc0 0x7fe9d4067140 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).stop 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 -- 172.21.15.50:0/3957337202 shutdown_connections 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 --2- 172.21.15.50:0/3957337202 >> v2:172.21.15.82:3300/0 conn(0x7fe9d409e540 0x7fe9d413c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 --2- 172.21.15.50:0/3957337202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d405ffc0 0x7fe9d4067140 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 -- 172.21.15.50:0/3957337202 >> 172.21.15.50:0/3957337202 conn(0x7fe9d40a8ae0 msgr2=0x7fe9d40a8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 -- 172.21.15.50:0/3957337202 shutdown_connections 2020-04-02T23:47:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.469+0000 7fe9dada4700 1 -- 172.21.15.50:0/3957337202 wait complete. 2020-04-02T23:47:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.470+0000 7fe9dada4700 1 Processor -- start 2020-04-02T23:47:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.470+0000 7fe9dada4700 1 -- start start 2020-04-02T23:47:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9dada4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9d405ffc0 0x7fe9d40aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9dada4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9d40603a0 0x7fe9d412c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9dada4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d40ab220 con 0x7fe9d409e540 2020-04-02T23:47:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9dada4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40ab7a0 con 0x7fe9d40603a0 2020-04-02T23:47:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9dada4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40aaf70 con 0x7fe9d405ffc0 2020-04-02T23:47:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9d40603a0 0x7fe9d412c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d9341700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9d409e540 0x7fe9d41273b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36232/0 (socket says 172.21.15.50:36232) 2020-04-02T23:47:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d9341700 1 -- 172.21.15.50:0/2710906131 learned_addr learned my addr 172.21.15.50:0/2710906131 (peer_addr_for_me v1:172.21.15.50:0/0) 2020-04-02T23:47:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/2710906131 >> v2:172.21.15.82:3300/0 conn(0x7fe9d405ffc0 0x7fe9d40aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 -- 172.21.15.50:0/2710906131 >> v2:172.21.15.82:3300/0 conn(0x7fe9d405ffc0 msgr2=0x7fe9d40aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> v2:172.21.15.82:3300/0 conn(0x7fe9d405ffc0 0x7fe9d40aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 -- 172.21.15.50:0/2710906131 >> v1:172.21.15.50:6789/0 conn(0x7fe9d409e540 legacy=0x7fe9d41273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520857722 0 0) 0x7fe9d40ab220 con 0x7fe9d409e540 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 -- 172.21.15.50:0/2710906131 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4137f20 con 0x7fe9d40603a0 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> v2:172.21.15.50:3300/0 conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> v2:172.21.15.50:3300/0 conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c800cc00 con 0x7fe9d40603a0 2020-04-02T23:47:19.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c800cda0 con 0x7fe9d40603a0 2020-04-02T23:47:19.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d412e400 con 0x7fe9d40603a0 2020-04-02T23:47:19.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.471+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c80110c0 con 0x7fe9d40603a0 2020-04-02T23:47:19.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.472+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d412bad0 con 0x7fe9d40603a0 2020-04-02T23:47:19.483 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.472+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.484 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.473+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d40ab610 con 0x7fe9d40603a0 2020-04-02T23:47:19.484 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.473+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe9c80064e0 con 0x7fe9d40603a0 2020-04-02T23:47:19.484 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.473+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.484 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.473+0000 7fe9d1ffb700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 0x7fe9b404f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.484 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.473+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe9c8060a20 con 0x7fe9d40603a0 2020-04-02T23:47:19.484 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.473+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 0x7fe9b404f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.484 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.474+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 0x7fe9b404f8c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.485 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.474+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 0x7fe9b404f8c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.485 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.474+0000 7fe9d8b40700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 0x7fe9b404f8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.486 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.476+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.486 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.476+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe9c803c180 con 0x7fe9d40603a0 2020-04-02T23:47:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.622+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9d4056c50 con 0x7fe9d40603a0 2020-04-02T23:47:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.622+0000 7fe9d3fff700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.622+0000 7fe9d1ffb700 1 -- 172.21.15.50:0/2710906131 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe9c803f7a0 con 0x7fe9d40603a0 2020-04-02T23:47:19.625 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2020-04-02T23:47:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.623+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 msgr2=0x7fe9b404f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.623+0000 7fe9dada4700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 0x7fe9b404f8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe9cc0032b0 tx=0x7fe9cc007dc0).stop 2020-04-02T23:47:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.623+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 msgr2=0x7fe9d412c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.623+0000 7fe9dada4700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fe9d409de90 tx=0x7fe9c80108e0).stop 2020-04-02T23:47:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.624+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 shutdown_connections 2020-04-02T23:47:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.624+0000 7fe9dada4700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe9b404d400 0x7fe9b404f8c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.624+0000 7fe9dada4700 1 --2- 172.21.15.50:0/2710906131 >> v2:172.21.15.82:3300/0 conn(0x7fe9d405ffc0 0x7fe9d40aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.624+0000 7fe9dada4700 1 --2- 172.21.15.50:0/2710906131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9d40603a0 0x7fe9d412c350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.624+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 >> 172.21.15.50:0/2710906131 conn(0x7fe9d40a8ae0 msgr2=0x7fe9d4132740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.624+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 shutdown_connections 2020-04-02T23:47:19.639 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.624+0000 7fe9dada4700 1 -- 172.21.15.50:0/2710906131 wait complete. 2020-04-02T23:47:19.639 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:19.652 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:47:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.807+0000 7fbb6dcea700 1 Processor -- start 2020-04-02T23:47:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.807+0000 7fbb6dcea700 1 -- start start 2020-04-02T23:47:19.815 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb6dcea700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 0x7fbb680a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:19.816 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb6dcea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb680a5f90 0x7fbb680a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:19.816 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb6dcea700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb680a2460 con 0x7fbb68066b00 2020-04-02T23:47:19.816 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb6dcea700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb680a4270 con 0x7fbb680a5f90 2020-04-02T23:47:19.816 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb6dcea700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680a3b50 con 0x7fbb680a3320 2020-04-02T23:47:19.816 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb677fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 0x7fbb680a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.816 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb677fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 0x7fbb680a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:56606/0 (socket says 172.21.15.50:56606) 2020-04-02T23:47:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb680a5f90 0x7fbb680a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb677fe700 1 -- 172.21.15.50:0/807820768 learned_addr learned my addr 172.21.15.50:0/807820768 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb67fff700 1 --1- 172.21.15.50:0/807820768 >> v1:172.21.15.50:6789/0 conn(0x7fbb68066b00 0x7fbb68066f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36236/0 (socket says 172.21.15.50:36236) 2020-04-02T23:47:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb677fe700 1 -- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 msgr2=0x7fbb680a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:47:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb677fe700 1 -- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 msgr2=0x7fbb680a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:47:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb677fe700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 0x7fbb680a4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:47:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb677fe700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 0x7fbb680a4fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 -- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 msgr2=0x7fbb680a4fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 0x7fbb680a4fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 -- 172.21.15.50:0/807820768 >> v1:172.21.15.50:6789/0 conn(0x7fbb68066b00 legacy=0x7fbb68066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb667fc700 1 -- 172.21.15.50:0/807820768 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172941832 0 0) 0x7fbb680a2460 con 0x7fbb68066b00 2020-04-02T23:47:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 -- 172.21.15.50:0/807820768 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680a5850 con 0x7fbb680a5f90 2020-04-02T23:47:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/807820768 >> v2:172.21.15.50:3300/0 conn(0x7fbb680a5f90 0x7fbb680a63f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/807820768 >> v2:172.21.15.50:3300/0 conn(0x7fbb680a5f90 0x7fbb680a63f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680a5f90 0x7fbb680a63f0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).ready entity=mon.0 client_cookie=104e51ec4a90063e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680a5f90 0x7fbb680a63f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb667fc700 1 -- 172.21.15.50:0/807820768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5c0113c0 con 0x7fbb680a5f90 2020-04-02T23:47:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.808+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680a5f90 0x7fbb680a63f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb667fc700 1 -- 172.21.15.50:0/807820768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c011520 con 0x7fbb680a5f90 2020-04-02T23:47:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680a5f90 0x7fbb680a63f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb667fc700 1 -- 172.21.15.50:0/807820768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5c011900 con 0x7fbb680a5f90 2020-04-02T23:47:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 -- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680a5f90 msgr2=0x7fbb680a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680a5f90 0x7fbb680a63f0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).stop 2020-04-02T23:47:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 -- 172.21.15.50:0/807820768 shutdown_connections 2020-04-02T23:47:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb680a3320 0x7fbb680a4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/807820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680a5f90 0x7fbb680a63f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 -- 172.21.15.50:0/807820768 >> 172.21.15.50:0/807820768 conn(0x7fbb680ab970 msgr2=0x7fbb680a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 -- 172.21.15.50:0/807820768 shutdown_connections 2020-04-02T23:47:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.809+0000 7fbb6dcea700 1 -- 172.21.15.50:0/807820768 wait complete. 2020-04-02T23:47:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.810+0000 7fbb6dcea700 1 Processor -- start 2020-04-02T23:47:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.810+0000 7fbb6dcea700 1 -- start start 2020-04-02T23:47:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb6dcea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb68066b00 0x7fbb68060aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb6dcea700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb680a5f90 0x7fbb68063070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb6dcea700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb680a2620 con 0x7fbb680a3320 2020-04-02T23:47:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb6dcea700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb680634d0 con 0x7fbb68066b00 2020-04-02T23:47:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb6dcea700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6812b7d0 con 0x7fbb680a5f90 2020-04-02T23:47:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb68066b00 0x7fbb68060aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb68066b00 0x7fbb68060aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50776/0 (socket says 172.21.15.50:50776) 2020-04-02T23:47:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 -- 172.21.15.50:0/4037336453 learned_addr learned my addr 172.21.15.50:0/4037336453 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 -- 172.21.15.50:0/4037336453 >> v2:172.21.15.82:3300/0 conn(0x7fbb680a5f90 msgr2=0x7fbb68063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> v2:172.21.15.82:3300/0 conn(0x7fbb680a5f90 0x7fbb68063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 -- 172.21.15.50:0/4037336453 >> v1:172.21.15.82:6789/0 conn(0x7fbb680a3320 legacy=0x7fbb6812bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 -- 172.21.15.50:0/4037336453 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680a1af0 con 0x7fbb68066b00 2020-04-02T23:47:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> v2:172.21.15.50:3300/0 conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> v2:172.21.15.50:3300/0 conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb64ff9700 1 -- 172.21.15.50:0/4037336453 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb58005e90 con 0x7fbb68066b00 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb64ff9700 1 -- 172.21.15.50:0/4037336453 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58007160 con 0x7fbb68066b00 2020-04-02T23:47:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb64ff9700 1 -- 172.21.15.50:0/4037336453 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb58007540 con 0x7fbb68066b00 2020-04-02T23:47:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb68061510 con 0x7fbb68066b00 2020-04-02T23:47:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.811+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6812c340 con 0x7fbb68066b00 2020-04-02T23:47:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.812+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.812+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6812b910 con 0x7fbb68066b00 2020-04-02T23:47:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.812+0000 7fbb64ff9700 1 -- 172.21.15.50:0/4037336453 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbb580123e0 con 0x7fbb68066b00 2020-04-02T23:47:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.812+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.813+0000 7fbb64ff9700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 0x7fbb4804fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.813+0000 7fbb64ff9700 1 -- 172.21.15.50:0/4037336453 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbb58061780 con 0x7fbb68066b00 2020-04-02T23:47:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.813+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 0x7fbb4804fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.813+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 0x7fbb4804fc10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.813+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 0x7fbb4804fc10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.813+0000 7fbb66ffd700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 0x7fbb4804fc10 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.816+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.816+0000 7fbb64ff9700 1 -- 172.21.15.50:0/4037336453 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fbb5803ce20 con 0x7fbb68066b00 2020-04-02T23:47:19.964 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.962+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb68056c50 con 0x7fbb68066b00 2020-04-02T23:47:19.964 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.962+0000 7fbb677fe700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:19.964 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.962+0000 7fbb64ff9700 1 -- 172.21.15.50:0/4037336453 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbb58040440 con 0x7fbb68066b00 2020-04-02T23:47:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2020-04-02T23:47:19.966 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 msgr2=0x7fbb4804fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.966 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 0x7fbb4804fc10 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fbb5c002f30 tx=0x7fbb5c007a40).stop 2020-04-02T23:47:19.966 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 msgr2=0x7fbb68060aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:19.966 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fbb680a8130 tx=0x7fbb58010d30).stop 2020-04-02T23:47:19.966 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 shutdown_connections 2020-04-02T23:47:19.967 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/4037336453 >> v2:172.21.15.82:3300/0 conn(0x7fbb680a5f90 0x7fbb68063070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.967 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb68066b00 0x7fbb68060aa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.967 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 --2- 172.21.15.50:0/4037336453 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fbb4804d750 0x7fbb4804fc10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:19.967 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 >> 172.21.15.50:0/4037336453 conn(0x7fbb680ab970 msgr2=0x7fbb6812fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:19.967 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 shutdown_connections 2020-04-02T23:47:19.967 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:19.964+0000 7fbb6dcea700 1 -- 172.21.15.50:0/4037336453 wait complete. 2020-04-02T23:47:19.975 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2020-04-02T23:47:19.976 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:19.992 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:47:20.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.148+0000 7f358c5df700 1 Processor -- start 2020-04-02T23:47:20.150 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.148+0000 7f358c5df700 1 -- start start 2020-04-02T23:47:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358c5df700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f35840aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358c5df700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3584136870 0x7f35840a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358c5df700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35840a5820 con 0x7f35840a4b70 2020-04-02T23:47:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358c5df700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35840a4130 con 0x7f35840a2ab0 2020-04-02T23:47:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358c5df700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840a43d0 con 0x7f3584136870 2020-04-02T23:47:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358a37b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f35840aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358a37b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f35840aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54734/0 (socket says 172.21.15.82:54734) 2020-04-02T23:47:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f3589b7a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f35840a4b70 0x7f3584136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54784/0 (socket says 172.21.15.82:54784) 2020-04-02T23:47:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358a37b700 1 -- 172.21.15.82:0/3946012668 learned_addr learned my addr 172.21.15.82:0/3946012668 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358ab7c700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3584136870 0x7f35840a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358a37b700 1 -- 172.21.15.82:0/3946012668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3584136870 msgr2=0x7f35840a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358a37b700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3584136870 0x7f35840a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358a37b700 1 -- 172.21.15.82:0/3946012668 >> v1:172.21.15.82:6789/0 conn(0x7f35840a4b70 legacy=0x7f3584136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f358a37b700 1 -- 172.21.15.82:0/3946012668 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840a4670 con 0x7f35840a2ab0 2020-04-02T23:47:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.149+0000 7f3589379700 1 -- 172.21.15.82:0/3946012668 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502264766 0 0) 0x7f35840a5820 con 0x7f35840a4b70 2020-04-02T23:47:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358a37b700 1 --2- 172.21.15.82:0/3946012668 >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f35840aae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358a37b700 1 --2- 172.21.15.82:0/3946012668 >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f35840aae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358a37b700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f35840aae80 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).ready entity=mon.1 client_cookie=87ed608b43076026 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358a37b700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f35840aae80 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f3589379700 1 -- 172.21.15.82:0/3946012668 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3574011670 con 0x7f35840a2ab0 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358a37b700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f35840aae80 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f3589379700 1 -- 172.21.15.82:0/3946012668 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35740117d0 con 0x7f35840a2ab0 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358a37b700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f35840aae80 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 -- 172.21.15.82:0/3946012668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 msgr2=0x7f35840aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f3589379700 1 -- 172.21.15.82:0/3946012668 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3574011bb0 con 0x7f35840a2ab0 2020-04-02T23:47:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f35840aae80 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).stop 2020-04-02T23:47:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 -- 172.21.15.82:0/3946012668 shutdown_connections 2020-04-02T23:47:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3584136870 0x7f35840a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 --2- 172.21.15.82:0/3946012668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f35840aae80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 -- 172.21.15.82:0/3946012668 >> 172.21.15.82:0/3946012668 conn(0x7f358409de60 msgr2=0x7f358409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 -- 172.21.15.82:0/3946012668 shutdown_connections 2020-04-02T23:47:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.150+0000 7f358c5df700 1 -- 172.21.15.82:0/3946012668 wait complete. 2020-04-02T23:47:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.151+0000 7f358c5df700 1 Processor -- start 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.151+0000 7f358c5df700 1 -- start start 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358c5df700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f3584061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358c5df700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35840a4b70 0x7f3584061ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358c5df700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3584064290 con 0x7f3584136870 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358c5df700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35840640a0 con 0x7f35840a2ab0 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358c5df700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3584064530 con 0x7f35840a4b70 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f3584061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.163 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358ab7c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3584136870 0x7f3584132260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54790/0 (socket says 172.21.15.82:54790) 2020-04-02T23:47:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358ab7c700 1 -- 172.21.15.82:0/2840173431 learned_addr learned my addr 172.21.15.82:0/2840173431 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f3589b7a700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35840a4b70 0x7f3584061ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 -- 172.21.15.82:0/2840173431 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35840a4b70 msgr2=0x7f3584061ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35840a4b70 0x7f3584061ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 -- 172.21.15.82:0/2840173431 >> v1:172.21.15.82:6789/0 conn(0x7f3584136870 legacy=0x7f3584132260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 -- 172.21.15.82:0/2840173431 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584066e80 con 0x7f35840a2ab0 2020-04-02T23:47:20.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751620955 0 0) 0x7f3584064290 con 0x7f3584136870 2020-04-02T23:47:20.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> v2:172.21.15.82:3300/0 conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3574011c70 con 0x7f35840a2ab0 2020-04-02T23:47:20.166 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574011e30 con 0x7f35840a2ab0 2020-04-02T23:47:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584062240 con 0x7f35840a2ab0 2020-04-02T23:47:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.152+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3574007530 con 0x7f35840a2ab0 2020-04-02T23:47:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.153+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358405bcc0 con 0x7f35840a2ab0 2020-04-02T23:47:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.153+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f35740056c0 con 0x7f35840a2ab0 2020-04-02T23:47:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584062ba0 con 0x7f35840a2ab0 2020-04-02T23:47:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f35737fe700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 0x7f356404f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3574061300 con 0x7f35840a2ab0 2020-04-02T23:47:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f3589b7a700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 0x7f356404f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f3589b7a700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 0x7f356404f910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3580000b80 tx=0x7f358000c900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f3589b7a700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 0x7f356404f910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3580000b80 tx=0x7f358000c900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.154+0000 7f3589b7a700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 0x7f356404f910 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f3580000b80 tx=0x7f358000c900).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.157+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.157+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f357403cb00 con 0x7f35840a2ab0 2020-04-02T23:47:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.339+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3584056c50 con 0x7f35840a2ab0 2020-04-02T23:47:20.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.339+0000 7f358a37b700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.339+0000 7f35737fe700 1 -- 172.21.15.82:0/2840173431 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f3574040120 con 0x7f35840a2ab0 2020-04-02T23:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:47:07.704695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:47:20.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.340+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 msgr2=0x7f356404f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.340+0000 7f358c5df700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 0x7f356404f910 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f3580000b80 tx=0x7f358000c900).stop 2020-04-02T23:47:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.340+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 msgr2=0x7f3584061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.340+0000 7f358c5df700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f3574002f30 tx=0x7f3574007a40).stop 2020-04-02T23:47:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.341+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 shutdown_connections 2020-04-02T23:47:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.341+0000 7f358c5df700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f356404d450 0x7f356404f910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.341+0000 7f358c5df700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35840a2ab0 0x7f3584061650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.341+0000 7f358c5df700 1 --2- 172.21.15.82:0/2840173431 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35840a4b70 0x7f3584061ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.341+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 >> 172.21.15.82:0/2840173431 conn(0x7f358409de60 msgr2=0x7f3584068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:20.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.341+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 shutdown_connections 2020-04-02T23:47:20.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:20.341+0000 7f358c5df700 1 -- 172.21.15.82:0/2840173431 wait complete. 2020-04-02T23:47:20.345 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2020-04-02T23:47:20.352 INFO:tasks.mds_thrash:Ready to start thrashing 2020-04-02T23:47:20.353 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2020-04-02T23:47:20.353 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:20.370 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:47:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.527+0000 7fa44855a700 1 Processor -- start 2020-04-02T23:47:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.527+0000 7fa44855a700 1 -- start start 2020-04-02T23:47:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa44855a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4400a3e20 0x7fa440138680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa44855a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa44855a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4400a77a0 con 0x7fa4400abb00 2020-04-02T23:47:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa44855a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4401395c0 con 0x7fa4400a3e20 2020-04-02T23:47:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa44855a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa440138ae0 con 0x7fa440066dd0 2020-04-02T23:47:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa445af5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4400a3e20 0x7fa440138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa445af5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4400a3e20 0x7fa440138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50786/0 (socket says 172.21.15.50:50786) 2020-04-02T23:47:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:56622/0 (socket says 172.21.15.50:56622) 2020-04-02T23:47:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa445af5700 1 -- 172.21.15.50:0/179735114 learned_addr learned my addr 172.21.15.50:0/179735114 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 -- 172.21.15.50:0/179735114 >> v2:172.21.15.50:3300/0 conn(0x7fa4400a3e20 msgr2=0x7fa440138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- 172.21.15.50:0/179735114 >> v2:172.21.15.50:3300/0 conn(0x7fa4400a3e20 0x7fa440138680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 -- 172.21.15.50:0/179735114 >> v1:172.21.15.82:6789/0 conn(0x7fa4400abb00 legacy=0x7fa4400666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 -- 172.21.15.50:0/179735114 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400a62b0 con 0x7fa440066dd0 2020-04-02T23:47:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa445af5700 1 --2- 172.21.15.50:0/179735114 >> v2:172.21.15.50:3300/0 conn(0x7fa4400a3e20 0x7fa440138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4380032b0 tx=0x7fa438007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4380032b0 tx=0x7fa438007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fa4380032b0 tx=0x7fa438007dc0).ready entity=mon.2 client_cookie=cd4c0d8642eaddce server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fa4380032b0 tx=0x7fa438007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fa4380032b0 tx=0x7fa438007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa4452f4700 1 -- 172.21.15.50:0/179735114 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa438011e20 con 0x7fa440066dd0 2020-04-02T23:47:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.528+0000 7fa446af7700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fa4380032b0 tx=0x7fa438007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa4452f4700 1 -- 172.21.15.50:0/179735114 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43800a160 con 0x7fa440066dd0 2020-04-02T23:47:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa4452f4700 1 -- 172.21.15.50:0/179735114 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43800a580 con 0x7fa440066dd0 2020-04-02T23:47:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 -- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 msgr2=0x7fa4400a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fa4380032b0 tx=0x7fa438007dc0).stop 2020-04-02T23:47:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 -- 172.21.15.50:0/179735114 shutdown_connections 2020-04-02T23:47:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 --2- 172.21.15.50:0/179735114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa440066dd0 0x7fa4400a69f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 --2- 172.21.15.50:0/179735114 >> v2:172.21.15.50:3300/0 conn(0x7fa4400a3e20 0x7fa440138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 -- 172.21.15.50:0/179735114 >> 172.21.15.50:0/179735114 conn(0x7fa44009de60 msgr2=0x7fa44009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 -- 172.21.15.50:0/179735114 shutdown_connections 2020-04-02T23:47:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.529+0000 7fa44855a700 1 -- 172.21.15.50:0/179735114 wait complete. 2020-04-02T23:47:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.530+0000 7fa44855a700 1 Processor -- start 2020-04-02T23:47:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.530+0000 7fa44855a700 1 -- start start 2020-04-02T23:47:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa44855a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa44855a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4400aafa0 con 0x7fa4400abb00 2020-04-02T23:47:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa44855a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa440128490 con 0x7fa440066dd0 2020-04-02T23:47:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa44855a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa440133a80 con 0x7fa4400a3e20 2020-04-02T23:47:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa446af7700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa4400abb00 0x7fa440121f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36260/0 (socket says 172.21.15.50:36260) 2020-04-02T23:47:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa446af7700 1 -- 172.21.15.50:0/4130219081 learned_addr learned my addr 172.21.15.50:0/4130219081 (peer_addr_for_me v1:172.21.15.50:0/0) 2020-04-02T23:47:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:56628/0 (socket says 172.21.15.50:56628) 2020-04-02T23:47:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094689538 0 0) 0x7fa4400aafa0 con 0x7fa4400abb00 2020-04-02T23:47:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 -- 172.21.15.50:0/4130219081 >> v1:172.21.15.82:6789/0 conn(0x7fa440066dd0 legacy=0x7fa440136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 -- 172.21.15.50:0/4130219081 >> v1:172.21.15.50:6789/0 conn(0x7fa4400abb00 legacy=0x7fa440121f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 -- 172.21.15.50:0/4130219081 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400ab1d0 con 0x7fa4400a3e20 2020-04-02T23:47:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa430012980 con 0x7fa4400a3e20 2020-04-02T23:47:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430012ae0 con 0x7fa4400a3e20 2020-04-02T23:47:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4300056c0 con 0x7fa4400a3e20 2020-04-02T23:47:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4400ab470 con 0x7fa4400a3e20 2020-04-02T23:47:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.531+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4401362a0 con 0x7fa4400a3e20 2020-04-02T23:47:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.532+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.532+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa430007180 con 0x7fa4400a3e20 2020-04-02T23:47:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa440136460 con 0x7fa4400a3e20 2020-04-02T23:47:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa42f7fe700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa430060de0 con 0x7fa4400a3e20 2020-04-02T23:47:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa4462f6700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa4462f6700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4400abf70 tx=0x7fa43c0014f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa4462f6700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4400abf70 tx=0x7fa43c0014f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.533+0000 7fa4462f6700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fa4400abf70 tx=0x7fa43c0014f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.536+0000 7fa445af5700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.536+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa43003c4e0 con 0x7fa4400a3e20 2020-04-02T23:47:20.681 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.679+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 --> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa440056c50 con 0x7fa42004d470 2020-04-02T23:47:20.686 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.682+0000 7fa4462f6700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fa4400abf70 tx=0x7fa43c0014f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.686 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.682+0000 7fa42f7fe700 1 -- 172.21.15.50:0/4130219081 <== mgr.4100 v2:172.21.15.82:6800/23559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82524 (secure 0 0 0) 0x7fa440056c50 con 0x7fa42004d470 2020-04-02T23:47:20.686 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 msgr2=0x7fa42004f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.686 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fa4400abf70 tx=0x7fa43c0014f0).stop 2020-04-02T23:47:20.687 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 msgr2=0x7fa440133620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.687 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fa430002f30 tx=0x7fa430010e30).stop 2020-04-02T23:47:20.687 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 shutdown_connections 2020-04-02T23:47:20.688 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fa42004d470 0x7fa42004f930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.688 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 --2- 172.21.15.50:0/4130219081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4400a3e20 0x7fa440133620 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.688 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 >> 172.21.15.50:0/4130219081 conn(0x7fa44009de60 msgr2=0x7fa440068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:20.688 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 shutdown_connections 2020-04-02T23:47:20.689 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.684+0000 7fa44855a700 1 -- 172.21.15.50:0/4130219081 wait complete. 2020-04-02T23:47:20.689 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2020-04-02T23:47:20.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:47:20.696 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2020-04-02T23:47:20.415487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390880,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583840,"statfs":{"total":773094113280,"available":764501852160,"internally_reserved":8589934592,"allocated":2260992,"data_stored":902940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002370"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715680+0000","last_change":"2020-04-02T23:47:03.714314+0000","last_active":"2020-04-02T23:47:03.715680+0000","last_peered":"2020-04-02T23:47:03.715680+0000","last_clean":"2020-04-02T23:47:03.715680+0000","last_became_active":"2020-04-02T23:47:03.713811+0000","last_became_peered":"2020-04-02T23:47:03.713811+0000","last_unstale":"2020-04-02T23:47:03.715680+0000","last_undegraded":"2020-04-02T23:47:03.715680+0000","last_fullsized":"2020-04-02T23:47:03.715680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697696+0000","last_change":"2020-04-02T23:46:57.674049+0000","last_active":"2020-04-02T23:47:03.697696+0000","last_peered":"2020-04-02T23:47:03.697696+0000","last_clean":"2020-04-02T23:47:03.697696+0000","last_became_active":"2020-04-02T23:46:57.673620+0000","last_became_peered":"2020-04-02T23:46:57.673620+0000","last_unstale":"2020-04-02T23:47:03.697696+0000","last_undegraded":"2020-04-02T23:47:03.697696+0000","last_fullsized":"2020-04-02T23:47:03.697696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716636+0000","last_change":"2020-04-02T23:47:00.307706+0000","last_active":"2020-04-02T23:47:06.716636+0000","last_peered":"2020-04-02T23:47:06.716636+0000","last_clean":"2020-04-02T23:47:06.716636+0000","last_became_active":"2020-04-02T23:47:00.307374+0000","last_became_peered":"2020-04-02T23:47:00.307374+0000","last_unstale":"2020-04-02T23:47:06.716636+0000","last_undegraded":"2020-04-02T23:47:06.716636+0000","last_fullsized":"2020-04-02T23:47:06.716636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715699+0000","last_change":"2020-04-02T23:47:03.714516+0000","last_active":"2020-04-02T23:47:03.715699+0000","last_peered":"2020-04-02T23:47:03.715699+0000","last_clean":"2020-04-02T23:47:03.715699+0000","last_became_active":"2020-04-02T23:47:03.713962+0000","last_became_peered":"2020-04-02T23:47:03.713962+0000","last_unstale":"2020-04-02T23:47:03.715699+0000","last_undegraded":"2020-04-02T23:47:03.715699+0000","last_fullsized":"2020-04-02T23:47:03.715699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697727+0000","last_change":"2020-04-02T23:46:57.673991+0000","last_active":"2020-04-02T23:47:03.697727+0000","last_peered":"2020-04-02T23:47:03.697727+0000","last_clean":"2020-04-02T23:47:03.697727+0000","last_became_active":"2020-04-02T23:46:57.673652+0000","last_became_peered":"2020-04-02T23:46:57.673652+0000","last_unstale":"2020-04-02T23:47:03.697727+0000","last_undegraded":"2020-04-02T23:47:03.697727+0000","last_fullsized":"2020-04-02T23:47:03.697727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712383+0000","last_change":"2020-04-02T23:47:00.308262+0000","last_active":"2020-04-02T23:47:06.712383+0000","last_peered":"2020-04-02T23:47:06.712383+0000","last_clean":"2020-04-02T23:47:06.712383+0000","last_became_active":"2020-04-02T23:47:00.307823+0000","last_became_peered":"2020-04-02T23:47:00.307823+0000","last_unstale":"2020-04-02T23:47:06.712383+0000","last_undegraded":"2020-04-02T23:47:06.712383+0000","last_fullsized":"2020-04-02T23:47:06.712383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715743+0000","last_change":"2020-04-02T23:47:03.714531+0000","last_active":"2020-04-02T23:47:03.715743+0000","last_peered":"2020-04-02T23:47:03.715743+0000","last_clean":"2020-04-02T23:47:03.715743+0000","last_became_active":"2020-04-02T23:47:03.713973+0000","last_became_peered":"2020-04-02T23:47:03.713973+0000","last_unstale":"2020-04-02T23:47:03.715743+0000","last_undegraded":"2020-04-02T23:47:03.715743+0000","last_fullsized":"2020-04-02T23:47:03.715743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.712773+0000","last_change":"2020-04-02T23:46:57.296429+0000","last_active":"2020-04-02T23:47:03.712773+0000","last_peered":"2020-04-02T23:47:03.712773+0000","last_clean":"2020-04-02T23:47:03.712773+0000","last_became_active":"2020-04-02T23:46:57.295976+0000","last_became_peered":"2020-04-02T23:46:57.295976+0000","last_unstale":"2020-04-02T23:47:03.712773+0000","last_undegraded":"2020-04-02T23:47:03.712773+0000","last_fullsized":"2020-04-02T23:47:03.712773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.714311+0000","last_change":"2020-04-02T23:47:00.850250+0000","last_active":"2020-04-02T23:47:06.714311+0000","last_peered":"2020-04-02T23:47:06.714311+0000","last_clean":"2020-04-02T23:47:06.714311+0000","last_became_active":"2020-04-02T23:47:00.849814+0000","last_became_peered":"2020-04-02T23:47:00.849814+0000","last_unstale":"2020-04-02T23:47:06.714311+0000","last_undegraded":"2020-04-02T23:47:06.714311+0000","last_fullsized":"2020-04-02T23:47:06.714311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.713953+0000","last_change":"2020-04-02T23:47:03.713504+0000","last_active":"2020-04-02T23:47:03.713953+0000","last_peered":"2020-04-02T23:47:03.713953+0000","last_clean":"2020-04-02T23:47:03.713953+0000","last_became_active":"2020-04-02T23:47:03.713114+0000","last_became_peered":"2020-04-02T23:47:03.713114+0000","last_unstale":"2020-04-02T23:47:03.713953+0000","last_undegraded":"2020-04-02T23:47:03.713953+0000","last_fullsized":"2020-04-02T23:47:03.713953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697497+0000","last_change":"2020-04-02T23:46:57.539513+0000","last_active":"2020-04-02T23:47:03.697497+0000","last_peered":"2020-04-02T23:47:03.697497+0000","last_clean":"2020-04-02T23:47:03.697497+0000","last_became_active":"2020-04-02T23:46:57.539173+0000","last_became_peered":"2020-04-02T23:46:57.539173+0000","last_unstale":"2020-04-02T23:47:03.697497+0000","last_undegraded":"2020-04-02T23:47:03.697497+0000","last_fullsized":"2020-04-02T23:47:03.697497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.699451+0000","last_change":"2020-04-02T23:46:52.433271+0000","last_active":"2020-04-02T23:47:03.699451+0000","last_peered":"2020-04-02T23:47:03.699451+0000","last_clean":"2020-04-02T23:47:03.699451+0000","last_became_active":"2020-04-02T23:46:52.432634+0000","last_became_peered":"2020-04-02T23:46:52.432634+0000","last_unstale":"2020-04-02T23:47:03.699451+0000","last_undegraded":"2020-04-02T23:47:03.699451+0000","last_fullsized":"2020-04-02T23:47:03.699451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_clean_scrub_stamp":"2020-04-02T23:46:43.408483+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:04.699349+0000","last_change":"2020-04-02T23:47:00.308009+0000","last_active":"2020-04-02T23:47:04.699349+0000","last_peered":"2020-04-02T23:47:04.699349+0000","last_clean":"2020-04-02T23:47:04.699349+0000","last_became_active":"2020-04-02T23:47:00.307627+0000","last_became_peered":"2020-04-02T23:47:00.307627+0000","last_unstale":"2020-04-02T23:47:04.699349+0000","last_undegraded":"2020-04-02T23:47:04.699349+0000","last_fullsized":"2020-04-02T23:47:04.699349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715345+0000","last_change":"2020-04-02T23:47:03.714857+0000","last_active":"2020-04-02T23:47:03.715345+0000","last_peered":"2020-04-02T23:47:03.715345+0000","last_clean":"2020-04-02T23:47:03.715345+0000","last_became_active":"2020-04-02T23:47:03.714083+0000","last_became_peered":"2020-04-02T23:47:03.714083+0000","last_unstale":"2020-04-02T23:47:03.715345+0000","last_undegraded":"2020-04-02T23:47:03.715345+0000","last_fullsized":"2020-04-02T23:47:03.715345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697556+0000","last_change":"2020-04-02T23:46:57.294003+0000","last_active":"2020-04-02T23:47:03.697556+0000","last_peered":"2020-04-02T23:47:03.697556+0000","last_clean":"2020-04-02T23:47:03.697556+0000","last_became_active":"2020-04-02T23:46:57.293787+0000","last_became_peered":"2020-04-02T23:46:57.293787+0000","last_unstale":"2020-04-02T23:47:03.697556+0000","last_undegraded":"2020-04-02T23:47:03.697556+0000","last_fullsized":"2020-04-02T23:47:03.697556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.701887+0000","last_change":"2020-04-02T23:47:00.308297+0000","last_active":"2020-04-02T23:47:03.701887+0000","last_peered":"2020-04-02T23:47:03.701887+0000","last_clean":"2020-04-02T23:47:03.701887+0000","last_became_active":"2020-04-02T23:47:00.307853+0000","last_became_peered":"2020-04-02T23:47:00.307853+0000","last_unstale":"2020-04-02T23:47:03.701887+0000","last_undegraded":"2020-04-02T23:47:03.701887+0000","last_fullsized":"2020-04-02T23:47:03.701887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.716205+0000","last_change":"2020-04-02T23:47:03.715568+0000","last_active":"2020-04-02T23:47:03.716205+0000","last_peered":"2020-04-02T23:47:03.716205+0000","last_clean":"2020-04-02T23:47:03.716205+0000","last_became_active":"2020-04-02T23:47:03.715040+0000","last_became_peered":"2020-04-02T23:47:03.715040+0000","last_unstale":"2020-04-02T23:47:03.716205+0000","last_undegraded":"2020-04-02T23:47:03.716205+0000","last_fullsized":"2020-04-02T23:47:03.716205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697664+0000","last_change":"2020-04-02T23:46:57.295764+0000","last_active":"2020-04-02T23:47:03.697664+0000","last_peered":"2020-04-02T23:47:03.697664+0000","last_clean":"2020-04-02T23:47:03.697664+0000","last_became_active":"2020-04-02T23:46:57.295494+0000","last_became_peered":"2020-04-02T23:46:57.295494+0000","last_unstale":"2020-04-02T23:47:03.697664+0000","last_undegraded":"2020-04-02T23:47:03.697664+0000","last_fullsized":"2020-04-02T23:47:03.697664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716992+0000","last_change":"2020-04-02T23:47:00.305677+0000","last_active":"2020-04-02T23:47:06.716992+0000","last_peered":"2020-04-02T23:47:06.716992+0000","last_clean":"2020-04-02T23:47:06.716992+0000","last_became_active":"2020-04-02T23:47:00.305290+0000","last_became_peered":"2020-04-02T23:47:00.305290+0000","last_unstale":"2020-04-02T23:47:06.716992+0000","last_undegraded":"2020-04-02T23:47:06.716992+0000","last_fullsized":"2020-04-02T23:47:06.716992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.703485+0000","last_change":"2020-04-02T23:47:03.703184+0000","last_active":"2020-04-02T23:47:03.703485+0000","last_peered":"2020-04-02T23:47:03.703485+0000","last_clean":"2020-04-02T23:47:03.703485+0000","last_became_active":"2020-04-02T23:47:03.702684+0000","last_became_peered":"2020-04-02T23:47:03.702684+0000","last_unstale":"2020-04-02T23:47:03.703485+0000","last_undegraded":"2020-04-02T23:47:03.703485+0000","last_fullsized":"2020-04-02T23:47:03.703485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'7","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716823+0000","last_change":"2020-04-02T23:47:00.306016+0000","last_active":"2020-04-02T23:47:06.716823+0000","last_peered":"2020-04-02T23:47:06.716823+0000","last_clean":"2020-04-02T23:47:06.716823+0000","last_became_active":"2020-04-02T23:47:00.305661+0000","last_became_peered":"2020-04-02T23:47:00.305661+0000","last_unstale":"2020-04-02T23:47:06.716823+0000","last_undegraded":"2020-04-02T23:47:06.716823+0000","last_fullsized":"2020-04-02T23:47:06.716823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702492+0000","last_change":"2020-04-02T23:46:57.713621+0000","last_active":"2020-04-02T23:47:03.702492+0000","last_peered":"2020-04-02T23:47:03.702492+0000","last_clean":"2020-04-02T23:47:03.702492+0000","last_became_active":"2020-04-02T23:46:57.713238+0000","last_became_peered":"2020-04-02T23:46:57.713238+0000","last_unstale":"2020-04-02T23:47:03.702492+0000","last_undegraded":"2020-04-02T23:47:03.702492+0000","last_fullsized":"2020-04-02T23:47:03.702492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702333+0000","last_change":"2020-04-02T23:47:03.702021+0000","last_active":"2020-04-02T23:47:03.702333+0000","last_peered":"2020-04-02T23:47:03.702333+0000","last_clean":"2020-04-02T23:47:03.702333+0000","last_became_active":"2020-04-02T23:47:03.701495+0000","last_became_peered":"2020-04-02T23:47:03.701495+0000","last_unstale":"2020-04-02T23:47:03.702333+0000","last_undegraded":"2020-04-02T23:47:03.702333+0000","last_fullsized":"2020-04-02T23:47:03.702333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697951+0000","last_change":"2020-04-02T23:46:57.713177+0000","last_active":"2020-04-02T23:47:03.697951+0000","last_peered":"2020-04-02T23:47:03.697951+0000","last_clean":"2020-04-02T23:47:03.697951+0000","last_became_active":"2020-04-02T23:46:57.712856+0000","last_became_peered":"2020-04-02T23:46:57.712856+0000","last_unstale":"2020-04-02T23:47:03.697951+0000","last_undegraded":"2020-04-02T23:47:03.697951+0000","last_fullsized":"2020-04-02T23:47:03.697951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712091+0000","last_change":"2020-04-02T23:47:00.850182+0000","last_active":"2020-04-02T23:47:06.712091+0000","last_peered":"2020-04-02T23:47:06.712091+0000","last_clean":"2020-04-02T23:47:06.712091+0000","last_became_active":"2020-04-02T23:47:00.849643+0000","last_became_peered":"2020-04-02T23:47:00.849643+0000","last_unstale":"2020-04-02T23:47:06.712091+0000","last_undegraded":"2020-04-02T23:47:06.712091+0000","last_fullsized":"2020-04-02T23:47:06.712091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048880,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322960,"statfs":{"total":96636764160,"available":95562711040,"internally_reserved":1073741824,"allocated":303104,"data_stored":114548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":339.52800000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":112490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":112862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":113822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]}]}} 2020-04-02T23:47:20.700 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:20.714 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:47:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.865+0000 7f11185ed700 1 Processor -- start 2020-04-02T23:47:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.865+0000 7f11185ed700 1 -- start start 2020-04-02T23:47:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f11185ed700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f11100a3e20 0x7f1110138680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f11185ed700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f11185ed700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11100a77a0 con 0x7f11100abb00 2020-04-02T23:47:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f11185ed700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11101395c0 con 0x7f11100a3e20 2020-04-02T23:47:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f11185ed700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1110138ae0 con 0x7f1110066dd0 2020-04-02T23:47:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:56638/0 (socket says 172.21.15.50:56638) 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 -- 172.21.15.50:0/196317418 learned_addr learned my addr 172.21.15.50:0/196317418 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1115b88700 1 --2- 172.21.15.50:0/196317418 >> v2:172.21.15.82:3300/0 conn(0x7f11100a3e20 0x7f1110138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 -- 172.21.15.50:0/196317418 >> v2:172.21.15.82:3300/0 conn(0x7f11100a3e20 msgr2=0x7f1110138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- 172.21.15.50:0/196317418 >> v2:172.21.15.82:3300/0 conn(0x7f11100a3e20 0x7f1110138680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 -- 172.21.15.50:0/196317418 >> v1:172.21.15.82:6789/0 conn(0x7f11100abb00 legacy=0x7f11100666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 -- 172.21.15.50:0/196317418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100a62b0 con 0x7f1110066dd0 2020-04-02T23:47:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11100abf70 tx=0x7f110c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11100abf70 tx=0x7f110c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f11100abf70 tx=0x7f110c007a40).ready entity=mon.2 client_cookie=eaff7637a75a55ba server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f11100abf70 tx=0x7f110c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1115387700 1 -- 172.21.15.50:0/196317418 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110c0116e0 con 0x7f1110066dd0 2020-04-02T23:47:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f11100abf70 tx=0x7f110c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1116b8a700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f11100abf70 tx=0x7f110c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1115387700 1 -- 172.21.15.50:0/196317418 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c011840 con 0x7f1110066dd0 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f1115387700 1 -- 172.21.15.50:0/196317418 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110c011c60 con 0x7f1110066dd0 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f11185ed700 1 -- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 msgr2=0x7f11100a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.866+0000 7f11185ed700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f11100abf70 tx=0x7f110c007a40).stop 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.867+0000 7f11185ed700 1 -- 172.21.15.50:0/196317418 shutdown_connections 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.867+0000 7f11185ed700 1 --2- 172.21.15.50:0/196317418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1110066dd0 0x7f11100a69f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.867+0000 7f11185ed700 1 --2- 172.21.15.50:0/196317418 >> v2:172.21.15.82:3300/0 conn(0x7f11100a3e20 0x7f1110138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.867+0000 7f11185ed700 1 -- 172.21.15.50:0/196317418 >> 172.21.15.50:0/196317418 conn(0x7f111009de60 msgr2=0x7f111009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.867+0000 7f11185ed700 1 -- 172.21.15.50:0/196317418 shutdown_connections 2020-04-02T23:47:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.867+0000 7f11185ed700 1 -- 172.21.15.50:0/196317418 wait complete. 2020-04-02T23:47:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.868+0000 7f11185ed700 1 Processor -- start 2020-04-02T23:47:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.868+0000 7f11185ed700 1 -- start start 2020-04-02T23:47:20.877 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.868+0000 7f11185ed700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1110066dd0 0x7f1110145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.868+0000 7f11185ed700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f11100abb00 0x7f1110145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.868+0000 7f11185ed700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1110136c00 con 0x7f11100a3e20 2020-04-02T23:47:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.868+0000 7f11185ed700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1110146400 con 0x7f1110066dd0 2020-04-02T23:47:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.868+0000 7f11185ed700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1110136e60 con 0x7f11100abb00 2020-04-02T23:47:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1110066dd0 0x7f1110145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1115b88700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f11100a3e20 0x7f11101302a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36272/0 (socket says 172.21.15.50:36272) 2020-04-02T23:47:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1115b88700 1 -- 172.21.15.50:0/267966659 learned_addr learned my addr 172.21.15.50:0/267966659 (peer_addr_for_me v1:172.21.15.50:0/0) 2020-04-02T23:47:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1110066dd0 0x7f1110145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50804/0 (socket says 172.21.15.50:50804) 2020-04-02T23:47:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116b8a700 1 --2- 172.21.15.50:0/267966659 >> v2:172.21.15.82:3300/0 conn(0x7f11100abb00 0x7f1110145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 -- 172.21.15.50:0/267966659 >> v2:172.21.15.82:3300/0 conn(0x7f11100abb00 msgr2=0x7f1110145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> v2:172.21.15.82:3300/0 conn(0x7f11100abb00 0x7f1110145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 -- 172.21.15.50:0/267966659 >> v1:172.21.15.50:6789/0 conn(0x7f11100a3e20 legacy=0x7f11101302a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115580476 0 0) 0x7f1110136c00 con 0x7f11100a3e20 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 -- 172.21.15.50:0/267966659 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100a1a20 con 0x7f1110066dd0 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> v2:172.21.15.50:3300/0 conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> v2:172.21.15.50:3300/0 conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.880 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1108012270 con 0x7f1110066dd0 2020-04-02T23:47:20.881 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.881 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.881 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11080123d0 con 0x7f1110066dd0 2020-04-02T23:47:20.881 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11101309b0 con 0x7f1110066dd0 2020-04-02T23:47:20.881 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11080127b0 con 0x7f1110066dd0 2020-04-02T23:47:20.881 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.869+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11100a05f0 con 0x7f1110066dd0 2020-04-02T23:47:20.881 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.870+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.870+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1110056c50 con 0x7f1110066dd0 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.870+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f11080129b0 con 0x7f1110066dd0 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.870+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.871+0000 7f10ff7fe700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.871+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1108061590 con 0x7f1110066dd0 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.871+0000 7f1115b88700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.871+0000 7f1115b88700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1100007a40 tx=0x7f1100001300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.882 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.871+0000 7f1115b88700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1100007a40 tx=0x7f1100001300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.883 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.871+0000 7f1115b88700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f1100007a40 tx=0x7f1100001300).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:20.883 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.874+0000 7f1116389700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:20.883 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:20.874+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f110803cc70 con 0x7f1110066dd0 2020-04-02T23:47:21.017 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.015+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 --> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f111005d150 con 0x7f10f004d420 2020-04-02T23:47:21.020 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.018+0000 7f1115b88700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f1100007a40 tx=0x7f1100001300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.020 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.018+0000 7f10ff7fe700 1 -- 172.21.15.50:0/267966659 <== mgr.4100 v2:172.21.15.82:6800/23559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82524 (secure 0 0 0) 0x7f111005d150 con 0x7f10f004d420 2020-04-02T23:47:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:47:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 msgr2=0x7f10f004f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f1100007a40 tx=0x7f1100001300).stop 2020-04-02T23:47:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 msgr2=0x7f1110145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f11080022d0 tx=0x7f1108010bd0).stop 2020-04-02T23:47:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 shutdown_connections 2020-04-02T23:47:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f10f004d420 0x7f10f004f8e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 --2- 172.21.15.50:0/267966659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1110066dd0 0x7f1110145a40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 --2- 172.21.15.50:0/267966659 >> v2:172.21.15.82:3300/0 conn(0x7f11100abb00 0x7f1110145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 >> 172.21.15.50:0/267966659 conn(0x7f111009de60 msgr2=0x7f1110068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 shutdown_connections 2020-04-02T23:47:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.020+0000 7f11185ed700 1 -- 172.21.15.50:0/267966659 wait complete. 2020-04-02T23:47:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2020-04-02T23:47:21.034 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2020-04-02T23:47:20.415487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390880,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583840,"statfs":{"total":773094113280,"available":764501852160,"internally_reserved":8589934592,"allocated":2260992,"data_stored":902940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002370"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715680+0000","last_change":"2020-04-02T23:47:03.714314+0000","last_active":"2020-04-02T23:47:03.715680+0000","last_peered":"2020-04-02T23:47:03.715680+0000","last_clean":"2020-04-02T23:47:03.715680+0000","last_became_active":"2020-04-02T23:47:03.713811+0000","last_became_peered":"2020-04-02T23:47:03.713811+0000","last_unstale":"2020-04-02T23:47:03.715680+0000","last_undegraded":"2020-04-02T23:47:03.715680+0000","last_fullsized":"2020-04-02T23:47:03.715680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697696+0000","last_change":"2020-04-02T23:46:57.674049+0000","last_active":"2020-04-02T23:47:03.697696+0000","last_peered":"2020-04-02T23:47:03.697696+0000","last_clean":"2020-04-02T23:47:03.697696+0000","last_became_active":"2020-04-02T23:46:57.673620+0000","last_became_peered":"2020-04-02T23:46:57.673620+0000","last_unstale":"2020-04-02T23:47:03.697696+0000","last_undegraded":"2020-04-02T23:47:03.697696+0000","last_fullsized":"2020-04-02T23:47:03.697696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716636+0000","last_change":"2020-04-02T23:47:00.307706+0000","last_active":"2020-04-02T23:47:06.716636+0000","last_peered":"2020-04-02T23:47:06.716636+0000","last_clean":"2020-04-02T23:47:06.716636+0000","last_became_active":"2020-04-02T23:47:00.307374+0000","last_became_peered":"2020-04-02T23:47:00.307374+0000","last_unstale":"2020-04-02T23:47:06.716636+0000","last_undegraded":"2020-04-02T23:47:06.716636+0000","last_fullsized":"2020-04-02T23:47:06.716636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715699+0000","last_change":"2020-04-02T23:47:03.714516+0000","last_active":"2020-04-02T23:47:03.715699+0000","last_peered":"2020-04-02T23:47:03.715699+0000","last_clean":"2020-04-02T23:47:03.715699+0000","last_became_active":"2020-04-02T23:47:03.713962+0000","last_became_peered":"2020-04-02T23:47:03.713962+0000","last_unstale":"2020-04-02T23:47:03.715699+0000","last_undegraded":"2020-04-02T23:47:03.715699+0000","last_fullsized":"2020-04-02T23:47:03.715699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697727+0000","last_change":"2020-04-02T23:46:57.673991+0000","last_active":"2020-04-02T23:47:03.697727+0000","last_peered":"2020-04-02T23:47:03.697727+0000","last_clean":"2020-04-02T23:47:03.697727+0000","last_became_active":"2020-04-02T23:46:57.673652+0000","last_became_peered":"2020-04-02T23:46:57.673652+0000","last_unstale":"2020-04-02T23:47:03.697727+0000","last_undegraded":"2020-04-02T23:47:03.697727+0000","last_fullsized":"2020-04-02T23:47:03.697727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712383+0000","last_change":"2020-04-02T23:47:00.308262+0000","last_active":"2020-04-02T23:47:06.712383+0000","last_peered":"2020-04-02T23:47:06.712383+0000","last_clean":"2020-04-02T23:47:06.712383+0000","last_became_active":"2020-04-02T23:47:00.307823+0000","last_became_peered":"2020-04-02T23:47:00.307823+0000","last_unstale":"2020-04-02T23:47:06.712383+0000","last_undegraded":"2020-04-02T23:47:06.712383+0000","last_fullsized":"2020-04-02T23:47:06.712383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715743+0000","last_change":"2020-04-02T23:47:03.714531+0000","last_active":"2020-04-02T23:47:03.715743+0000","last_peered":"2020-04-02T23:47:03.715743+0000","last_clean":"2020-04-02T23:47:03.715743+0000","last_became_active":"2020-04-02T23:47:03.713973+0000","last_became_peered":"2020-04-02T23:47:03.713973+0000","last_unstale":"2020-04-02T23:47:03.715743+0000","last_undegraded":"2020-04-02T23:47:03.715743+0000","last_fullsized":"2020-04-02T23:47:03.715743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.712773+0000","last_change":"2020-04-02T23:46:57.296429+0000","last_active":"2020-04-02T23:47:03.712773+0000","last_peered":"2020-04-02T23:47:03.712773+0000","last_clean":"2020-04-02T23:47:03.712773+0000","last_became_active":"2020-04-02T23:46:57.295976+0000","last_became_peered":"2020-04-02T23:46:57.295976+0000","last_unstale":"2020-04-02T23:47:03.712773+0000","last_undegraded":"2020-04-02T23:47:03.712773+0000","last_fullsized":"2020-04-02T23:47:03.712773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.714311+0000","last_change":"2020-04-02T23:47:00.850250+0000","last_active":"2020-04-02T23:47:06.714311+0000","last_peered":"2020-04-02T23:47:06.714311+0000","last_clean":"2020-04-02T23:47:06.714311+0000","last_became_active":"2020-04-02T23:47:00.849814+0000","last_became_peered":"2020-04-02T23:47:00.849814+0000","last_unstale":"2020-04-02T23:47:06.714311+0000","last_undegraded":"2020-04-02T23:47:06.714311+0000","last_fullsized":"2020-04-02T23:47:06.714311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.713953+0000","last_change":"2020-04-02T23:47:03.713504+0000","last_active":"2020-04-02T23:47:03.713953+0000","last_peered":"2020-04-02T23:47:03.713953+0000","last_clean":"2020-04-02T23:47:03.713953+0000","last_became_active":"2020-04-02T23:47:03.713114+0000","last_became_peered":"2020-04-02T23:47:03.713114+0000","last_unstale":"2020-04-02T23:47:03.713953+0000","last_undegraded":"2020-04-02T23:47:03.713953+0000","last_fullsized":"2020-04-02T23:47:03.713953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697497+0000","last_change":"2020-04-02T23:46:57.539513+0000","last_active":"2020-04-02T23:47:03.697497+0000","last_peered":"2020-04-02T23:47:03.697497+0000","last_clean":"2020-04-02T23:47:03.697497+0000","last_became_active":"2020-04-02T23:46:57.539173+0000","last_became_peered":"2020-04-02T23:46:57.539173+0000","last_unstale":"2020-04-02T23:47:03.697497+0000","last_undegraded":"2020-04-02T23:47:03.697497+0000","last_fullsized":"2020-04-02T23:47:03.697497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.699451+0000","last_change":"2020-04-02T23:46:52.433271+0000","last_active":"2020-04-02T23:47:03.699451+0000","last_peered":"2020-04-02T23:47:03.699451+0000","last_clean":"2020-04-02T23:47:03.699451+0000","last_became_active":"2020-04-02T23:46:52.432634+0000","last_became_peered":"2020-04-02T23:46:52.432634+0000","last_unstale":"2020-04-02T23:47:03.699451+0000","last_undegraded":"2020-04-02T23:47:03.699451+0000","last_fullsized":"2020-04-02T23:47:03.699451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_clean_scrub_stamp":"2020-04-02T23:46:43.408483+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:04.699349+0000","last_change":"2020-04-02T23:47:00.308009+0000","last_active":"2020-04-02T23:47:04.699349+0000","last_peered":"2020-04-02T23:47:04.699349+0000","last_clean":"2020-04-02T23:47:04.699349+0000","last_became_active":"2020-04-02T23:47:00.307627+0000","last_became_peered":"2020-04-02T23:47:00.307627+0000","last_unstale":"2020-04-02T23:47:04.699349+0000","last_undegraded":"2020-04-02T23:47:04.699349+0000","last_fullsized":"2020-04-02T23:47:04.699349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715345+0000","last_change":"2020-04-02T23:47:03.714857+0000","last_active":"2020-04-02T23:47:03.715345+0000","last_peered":"2020-04-02T23:47:03.715345+0000","last_clean":"2020-04-02T23:47:03.715345+0000","last_became_active":"2020-04-02T23:47:03.714083+0000","last_became_peered":"2020-04-02T23:47:03.714083+0000","last_unstale":"2020-04-02T23:47:03.715345+0000","last_undegraded":"2020-04-02T23:47:03.715345+0000","last_fullsized":"2020-04-02T23:47:03.715345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697556+0000","last_change":"2020-04-02T23:46:57.294003+0000","last_active":"2020-04-02T23:47:03.697556+0000","last_peered":"2020-04-02T23:47:03.697556+0000","last_clean":"2020-04-02T23:47:03.697556+0000","last_became_active":"2020-04-02T23:46:57.293787+0000","last_became_peered":"2020-04-02T23:46:57.293787+0000","last_unstale":"2020-04-02T23:47:03.697556+0000","last_undegraded":"2020-04-02T23:47:03.697556+0000","last_fullsized":"2020-04-02T23:47:03.697556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.701887+0000","last_change":"2020-04-02T23:47:00.308297+0000","last_active":"2020-04-02T23:47:03.701887+0000","last_peered":"2020-04-02T23:47:03.701887+0000","last_clean":"2020-04-02T23:47:03.701887+0000","last_became_active":"2020-04-02T23:47:00.307853+0000","last_became_peered":"2020-04-02T23:47:00.307853+0000","last_unstale":"2020-04-02T23:47:03.701887+0000","last_undegraded":"2020-04-02T23:47:03.701887+0000","last_fullsized":"2020-04-02T23:47:03.701887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.716205+0000","last_change":"2020-04-02T23:47:03.715568+0000","last_active":"2020-04-02T23:47:03.716205+0000","last_peered":"2020-04-02T23:47:03.716205+0000","last_clean":"2020-04-02T23:47:03.716205+0000","last_became_active":"2020-04-02T23:47:03.715040+0000","last_became_peered":"2020-04-02T23:47:03.715040+0000","last_unstale":"2020-04-02T23:47:03.716205+0000","last_undegraded":"2020-04-02T23:47:03.716205+0000","last_fullsized":"2020-04-02T23:47:03.716205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697664+0000","last_change":"2020-04-02T23:46:57.295764+0000","last_active":"2020-04-02T23:47:03.697664+0000","last_peered":"2020-04-02T23:47:03.697664+0000","last_clean":"2020-04-02T23:47:03.697664+0000","last_became_active":"2020-04-02T23:46:57.295494+0000","last_became_peered":"2020-04-02T23:46:57.295494+0000","last_unstale":"2020-04-02T23:47:03.697664+0000","last_undegraded":"2020-04-02T23:47:03.697664+0000","last_fullsized":"2020-04-02T23:47:03.697664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716992+0000","last_change":"2020-04-02T23:47:00.305677+0000","last_active":"2020-04-02T23:47:06.716992+0000","last_peered":"2020-04-02T23:47:06.716992+0000","last_clean":"2020-04-02T23:47:06.716992+0000","last_became_active":"2020-04-02T23:47:00.305290+0000","last_became_peered":"2020-04-02T23:47:00.305290+0000","last_unstale":"2020-04-02T23:47:06.716992+0000","last_undegraded":"2020-04-02T23:47:06.716992+0000","last_fullsized":"2020-04-02T23:47:06.716992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.703485+0000","last_change":"2020-04-02T23:47:03.703184+0000","last_active":"2020-04-02T23:47:03.703485+0000","last_peered":"2020-04-02T23:47:03.703485+0000","last_clean":"2020-04-02T23:47:03.703485+0000","last_became_active":"2020-04-02T23:47:03.702684+0000","last_became_peered":"2020-04-02T23:47:03.702684+0000","last_unstale":"2020-04-02T23:47:03.703485+0000","last_undegraded":"2020-04-02T23:47:03.703485+0000","last_fullsized":"2020-04-02T23:47:03.703485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'7","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716823+0000","last_change":"2020-04-02T23:47:00.306016+0000","last_active":"2020-04-02T23:47:06.716823+0000","last_peered":"2020-04-02T23:47:06.716823+0000","last_clean":"2020-04-02T23:47:06.716823+0000","last_became_active":"2020-04-02T23:47:00.305661+0000","last_became_peered":"2020-04-02T23:47:00.305661+0000","last_unstale":"2020-04-02T23:47:06.716823+0000","last_undegraded":"2020-04-02T23:47:06.716823+0000","last_fullsized":"2020-04-02T23:47:06.716823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702492+0000","last_change":"2020-04-02T23:46:57.713621+0000","last_active":"2020-04-02T23:47:03.702492+0000","last_peered":"2020-04-02T23:47:03.702492+0000","last_clean":"2020-04-02T23:47:03.702492+0000","last_became_active":"2020-04-02T23:46:57.713238+0000","last_became_peered":"2020-04-02T23:46:57.713238+0000","last_unstale":"2020-04-02T23:47:03.702492+0000","last_undegraded":"2020-04-02T23:47:03.702492+0000","last_fullsized":"2020-04-02T23:47:03.702492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702333+0000","last_change":"2020-04-02T23:47:03.702021+0000","last_active":"2020-04-02T23:47:03.702333+0000","last_peered":"2020-04-02T23:47:03.702333+0000","last_clean":"2020-04-02T23:47:03.702333+0000","last_became_active":"2020-04-02T23:47:03.701495+0000","last_became_peered":"2020-04-02T23:47:03.701495+0000","last_unstale":"2020-04-02T23:47:03.702333+0000","last_undegraded":"2020-04-02T23:47:03.702333+0000","last_fullsized":"2020-04-02T23:47:03.702333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697951+0000","last_change":"2020-04-02T23:46:57.713177+0000","last_active":"2020-04-02T23:47:03.697951+0000","last_peered":"2020-04-02T23:47:03.697951+0000","last_clean":"2020-04-02T23:47:03.697951+0000","last_became_active":"2020-04-02T23:46:57.712856+0000","last_became_peered":"2020-04-02T23:46:57.712856+0000","last_unstale":"2020-04-02T23:47:03.697951+0000","last_undegraded":"2020-04-02T23:47:03.697951+0000","last_fullsized":"2020-04-02T23:47:03.697951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712091+0000","last_change":"2020-04-02T23:47:00.850182+0000","last_active":"2020-04-02T23:47:06.712091+0000","last_peered":"2020-04-02T23:47:06.712091+0000","last_clean":"2020-04-02T23:47:06.712091+0000","last_became_active":"2020-04-02T23:47:00.849643+0000","last_became_peered":"2020-04-02T23:47:00.849643+0000","last_unstale":"2020-04-02T23:47:06.712091+0000","last_undegraded":"2020-04-02T23:47:06.712091+0000","last_fullsized":"2020-04-02T23:47:06.712091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048880,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322960,"statfs":{"total":96636764160,"available":95562711040,"internally_reserved":1073741824,"allocated":303104,"data_stored":114548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":339.52800000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":112490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":112862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":113822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]}]}} 2020-04-02T23:47:21.037 INFO:tasks.mds_thrash.ceph_manager:clean! 2020-04-02T23:47:21.038 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:21.052 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:47:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.202+0000 7f5fd4fd6700 1 Processor -- start 2020-04-02T23:47:21.205 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.202+0000 7f5fd4fd6700 1 -- start start 2020-04-02T23:47:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fd4fd6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fd4fd6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fd4fd6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00a77a0 con 0x7f5fd00666c0 2020-04-02T23:47:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fd4fd6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd01395c0 con 0x7f5fd0138680 2020-04-02T23:47:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fd4fd6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0138ae0 con 0x7f5fd00abb00 2020-04-02T23:47:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fce59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fcdd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fced9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fd00666c0 0x7f5fd0066b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36278/0 (socket says 172.21.15.50:36278) 2020-04-02T23:47:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.203+0000 7f5fced9d700 1 -- 172.21.15.50:0/1944029613 learned_addr learned my addr 172.21.15.50:0/1944029613 (peer_addr_for_me v1:172.21.15.50:0/0) 2020-04-02T23:47:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fcd59a700 1 -- 172.21.15.50:0/1944029613 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069432427 0 0) 0x7f5fd00a77a0 con 0x7f5fd00666c0 2020-04-02T23:47:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fcd59a700 1 -- 172.21.15.50:0/1944029613 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb0003230 con 0x7f5fd00666c0 2020-04-02T23:47:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 -- 172.21.15.50:0/1944029613 >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 msgr2=0x7f5fd00a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 --2- 172.21.15.50:0/1944029613 >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 -- 172.21.15.50:0/1944029613 >> v1:172.21.15.50:6789/0 conn(0x7f5fd00666c0 legacy=0x7f5fd0066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 -- 172.21.15.50:0/1944029613 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00a62b0 con 0x7f5fd00abb00 2020-04-02T23:47:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fcdd9b700 1 --2- 172.21.15.50:0/1944029613 >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5fb8002f30 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5fb8002f30 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f5fb8002f30 tx=0x7f5fb8007a40).ready entity=mon.2 client_cookie=fe7a38ab1a57fb3e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f5fb8002f30 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fcd59a700 1 -- 172.21.15.50:0/1944029613 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fb8011500 con 0x7f5fd00abb00 2020-04-02T23:47:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f5fb8002f30 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fcd59a700 1 -- 172.21.15.50:0/1944029613 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb8011660 con 0x7f5fd00abb00 2020-04-02T23:47:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fce59c700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f5fb8002f30 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fcd59a700 1 -- 172.21.15.50:0/1944029613 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fb8011a80 con 0x7f5fd00abb00 2020-04-02T23:47:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 msgr2=0x7f5fd00a3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.204+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f5fb8002f30 tx=0x7f5fb8007a40).stop 2020-04-02T23:47:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.205+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/1944029613 shutdown_connections 2020-04-02T23:47:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.205+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/1944029613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a3e20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.205+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/1944029613 >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.205+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/1944029613 >> 172.21.15.50:0/1944029613 conn(0x7f5fd009de60 msgr2=0x7f5fd009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.205+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/1944029613 shutdown_connections 2020-04-02T23:47:21.216 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.205+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/1944029613 wait complete. 2020-04-02T23:47:21.216 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fd4fd6700 1 Processor -- start 2020-04-02T23:47:21.216 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fd4fd6700 1 -- start start 2020-04-02T23:47:21.216 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fd4fd6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.216 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fd4fd6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.216 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fd4fd6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd0135050 con 0x7f5fd00666c0 2020-04-02T23:47:21.217 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fd4fd6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00a0f10 con 0x7f5fd0138680 2020-04-02T23:47:21.217 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fd4fd6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd00a08f0 con 0x7f5fd00abb00 2020-04-02T23:47:21.217 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fcdd9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.217 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fced9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.217 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fcdd9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:56656/0 (socket says 172.21.15.50:56656) 2020-04-02T23:47:21.217 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.206+0000 7f5fcdd9b700 1 -- 172.21.15.50:0/3794940202 learned_addr learned my addr 172.21.15.50:0/3794940202 (peer_addr_for_me v2:172.21.15.50:0/0) 2020-04-02T23:47:21.217 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 -- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 msgr2=0x7f5fd00a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 -- 172.21.15.50:0/3794940202 >> v1:172.21.15.82:6789/0 conn(0x7f5fd00666c0 legacy=0x7f5fd0146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 -- 172.21.15.50:0/3794940202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd009fff0 con 0x7f5fd0138680 2020-04-02T23:47:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fcdd9b700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> v2:172.21.15.50:3300/0 conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fc77fe700 1 -- 172.21.15.50:0/3794940202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fc8005e50 con 0x7f5fd0138680 2020-04-02T23:47:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fc77fe700 1 -- 172.21.15.50:0/3794940202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc8014670 con 0x7f5fd0138680 2020-04-02T23:47:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd0132c50 con 0x7f5fd0138680 2020-04-02T23:47:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fc77fe700 1 -- 172.21.15.50:0/3794940202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fc8014a90 con 0x7f5fd0138680 2020-04-02T23:47:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.207+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd0135ea0 con 0x7f5fd0138680 2020-04-02T23:47:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.208+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.208+0000 7f5fc77fe700 1 -- 172.21.15.50:0/3794940202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5fc8014bf0 con 0x7f5fd0138680 2020-04-02T23:47:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.208+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.208+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd0061bc0 con 0x7f5fd0138680 2020-04-02T23:47:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.208+0000 7f5fc77fe700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.208+0000 7f5fc77fe700 1 -- 172.21.15.50:0/3794940202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5fc8063390 con 0x7f5fd0138680 2020-04-02T23:47:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.209+0000 7f5fce59c700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.209+0000 7f5fce59c700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5fd005c600 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.209+0000 7f5fce59c700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5fd005c600 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.209+0000 7f5fce59c700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f5fd005c600 tx=0x7f5fb8007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.232 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.212+0000 7f5fced9d700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.232 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.212+0000 7f5fc77fe700 1 -- 172.21.15.50:0/3794940202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f5fc803ea30 con 0x7f5fd0138680 2020-04-02T23:47:21.356 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.354+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 --> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fd0056c50 con 0x7f5fb404d500 2020-04-02T23:47:21.362 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.358+0000 7f5fce59c700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5fd005c600 tx=0x7f5fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.362 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.358+0000 7f5fc77fe700 1 -- 172.21.15.50:0/3794940202 <== mgr.4100 v2:172.21.15.82:6800/23559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82524 (secure 0 0 0) 0x7f5fd0056c50 con 0x7f5fb404d500 2020-04-02T23:47:21.362 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 msgr2=0x7f5fb404f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.362 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f5fd005c600 tx=0x7f5fb8007a40).stop 2020-04-02T23:47:21.363 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 msgr2=0x7f5fd00a0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.363 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f5fc8001450 tx=0x7f5fc8012de0).stop 2020-04-02T23:47:21.363 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 shutdown_connections 2020-04-02T23:47:21.363 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd0138680 0x7f5fd00a0490 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.363 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5fb404d500 0x7f5fb404f9c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 --2- 172.21.15.50:0/3794940202 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5fd00abb00 0x7f5fd00a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 >> 172.21.15.50:0/3794940202 conn(0x7f5fd009de60 msgr2=0x7f5fd00a37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.359+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 shutdown_connections 2020-04-02T23:47:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2020-04-02T23:47:21.360+0000 7f5fd4fd6700 1 -- 172.21.15.50:0/3794940202 wait complete. 2020-04-02T23:47:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2020-04-02T23:47:21.365 INFO:teuthology.orchestra.run.smithi050.stdout: 2020-04-02T23:47:21.371 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2020-04-02T23:47:20.415487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390880,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583840,"statfs":{"total":773094113280,"available":764501852160,"internally_reserved":8589934592,"allocated":2260992,"data_stored":902940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002370"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715680+0000","last_change":"2020-04-02T23:47:03.714314+0000","last_active":"2020-04-02T23:47:03.715680+0000","last_peered":"2020-04-02T23:47:03.715680+0000","last_clean":"2020-04-02T23:47:03.715680+0000","last_became_active":"2020-04-02T23:47:03.713811+0000","last_became_peered":"2020-04-02T23:47:03.713811+0000","last_unstale":"2020-04-02T23:47:03.715680+0000","last_undegraded":"2020-04-02T23:47:03.715680+0000","last_fullsized":"2020-04-02T23:47:03.715680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697696+0000","last_change":"2020-04-02T23:46:57.674049+0000","last_active":"2020-04-02T23:47:03.697696+0000","last_peered":"2020-04-02T23:47:03.697696+0000","last_clean":"2020-04-02T23:47:03.697696+0000","last_became_active":"2020-04-02T23:46:57.673620+0000","last_became_peered":"2020-04-02T23:46:57.673620+0000","last_unstale":"2020-04-02T23:47:03.697696+0000","last_undegraded":"2020-04-02T23:47:03.697696+0000","last_fullsized":"2020-04-02T23:47:03.697696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716636+0000","last_change":"2020-04-02T23:47:00.307706+0000","last_active":"2020-04-02T23:47:06.716636+0000","last_peered":"2020-04-02T23:47:06.716636+0000","last_clean":"2020-04-02T23:47:06.716636+0000","last_became_active":"2020-04-02T23:47:00.307374+0000","last_became_peered":"2020-04-02T23:47:00.307374+0000","last_unstale":"2020-04-02T23:47:06.716636+0000","last_undegraded":"2020-04-02T23:47:06.716636+0000","last_fullsized":"2020-04-02T23:47:06.716636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715699+0000","last_change":"2020-04-02T23:47:03.714516+0000","last_active":"2020-04-02T23:47:03.715699+0000","last_peered":"2020-04-02T23:47:03.715699+0000","last_clean":"2020-04-02T23:47:03.715699+0000","last_became_active":"2020-04-02T23:47:03.713962+0000","last_became_peered":"2020-04-02T23:47:03.713962+0000","last_unstale":"2020-04-02T23:47:03.715699+0000","last_undegraded":"2020-04-02T23:47:03.715699+0000","last_fullsized":"2020-04-02T23:47:03.715699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697727+0000","last_change":"2020-04-02T23:46:57.673991+0000","last_active":"2020-04-02T23:47:03.697727+0000","last_peered":"2020-04-02T23:47:03.697727+0000","last_clean":"2020-04-02T23:47:03.697727+0000","last_became_active":"2020-04-02T23:46:57.673652+0000","last_became_peered":"2020-04-02T23:46:57.673652+0000","last_unstale":"2020-04-02T23:47:03.697727+0000","last_undegraded":"2020-04-02T23:47:03.697727+0000","last_fullsized":"2020-04-02T23:47:03.697727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712383+0000","last_change":"2020-04-02T23:47:00.308262+0000","last_active":"2020-04-02T23:47:06.712383+0000","last_peered":"2020-04-02T23:47:06.712383+0000","last_clean":"2020-04-02T23:47:06.712383+0000","last_became_active":"2020-04-02T23:47:00.307823+0000","last_became_peered":"2020-04-02T23:47:00.307823+0000","last_unstale":"2020-04-02T23:47:06.712383+0000","last_undegraded":"2020-04-02T23:47:06.712383+0000","last_fullsized":"2020-04-02T23:47:06.712383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715743+0000","last_change":"2020-04-02T23:47:03.714531+0000","last_active":"2020-04-02T23:47:03.715743+0000","last_peered":"2020-04-02T23:47:03.715743+0000","last_clean":"2020-04-02T23:47:03.715743+0000","last_became_active":"2020-04-02T23:47:03.713973+0000","last_became_peered":"2020-04-02T23:47:03.713973+0000","last_unstale":"2020-04-02T23:47:03.715743+0000","last_undegraded":"2020-04-02T23:47:03.715743+0000","last_fullsized":"2020-04-02T23:47:03.715743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.712773+0000","last_change":"2020-04-02T23:46:57.296429+0000","last_active":"2020-04-02T23:47:03.712773+0000","last_peered":"2020-04-02T23:47:03.712773+0000","last_clean":"2020-04-02T23:47:03.712773+0000","last_became_active":"2020-04-02T23:46:57.295976+0000","last_became_peered":"2020-04-02T23:46:57.295976+0000","last_unstale":"2020-04-02T23:47:03.712773+0000","last_undegraded":"2020-04-02T23:47:03.712773+0000","last_fullsized":"2020-04-02T23:47:03.712773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.714311+0000","last_change":"2020-04-02T23:47:00.850250+0000","last_active":"2020-04-02T23:47:06.714311+0000","last_peered":"2020-04-02T23:47:06.714311+0000","last_clean":"2020-04-02T23:47:06.714311+0000","last_became_active":"2020-04-02T23:47:00.849814+0000","last_became_peered":"2020-04-02T23:47:00.849814+0000","last_unstale":"2020-04-02T23:47:06.714311+0000","last_undegraded":"2020-04-02T23:47:06.714311+0000","last_fullsized":"2020-04-02T23:47:06.714311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.713953+0000","last_change":"2020-04-02T23:47:03.713504+0000","last_active":"2020-04-02T23:47:03.713953+0000","last_peered":"2020-04-02T23:47:03.713953+0000","last_clean":"2020-04-02T23:47:03.713953+0000","last_became_active":"2020-04-02T23:47:03.713114+0000","last_became_peered":"2020-04-02T23:47:03.713114+0000","last_unstale":"2020-04-02T23:47:03.713953+0000","last_undegraded":"2020-04-02T23:47:03.713953+0000","last_fullsized":"2020-04-02T23:47:03.713953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697497+0000","last_change":"2020-04-02T23:46:57.539513+0000","last_active":"2020-04-02T23:47:03.697497+0000","last_peered":"2020-04-02T23:47:03.697497+0000","last_clean":"2020-04-02T23:47:03.697497+0000","last_became_active":"2020-04-02T23:46:57.539173+0000","last_became_peered":"2020-04-02T23:46:57.539173+0000","last_unstale":"2020-04-02T23:47:03.697497+0000","last_undegraded":"2020-04-02T23:47:03.697497+0000","last_fullsized":"2020-04-02T23:47:03.697497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.699451+0000","last_change":"2020-04-02T23:46:52.433271+0000","last_active":"2020-04-02T23:47:03.699451+0000","last_peered":"2020-04-02T23:47:03.699451+0000","last_clean":"2020-04-02T23:47:03.699451+0000","last_became_active":"2020-04-02T23:46:52.432634+0000","last_became_peered":"2020-04-02T23:46:52.432634+0000","last_unstale":"2020-04-02T23:47:03.699451+0000","last_undegraded":"2020-04-02T23:47:03.699451+0000","last_fullsized":"2020-04-02T23:47:03.699451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:43.408483+0000","last_clean_scrub_stamp":"2020-04-02T23:46:43.408483+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:04.699349+0000","last_change":"2020-04-02T23:47:00.308009+0000","last_active":"2020-04-02T23:47:04.699349+0000","last_peered":"2020-04-02T23:47:04.699349+0000","last_clean":"2020-04-02T23:47:04.699349+0000","last_became_active":"2020-04-02T23:47:00.307627+0000","last_became_peered":"2020-04-02T23:47:00.307627+0000","last_unstale":"2020-04-02T23:47:04.699349+0000","last_undegraded":"2020-04-02T23:47:04.699349+0000","last_fullsized":"2020-04-02T23:47:04.699349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.715345+0000","last_change":"2020-04-02T23:47:03.714857+0000","last_active":"2020-04-02T23:47:03.715345+0000","last_peered":"2020-04-02T23:47:03.715345+0000","last_clean":"2020-04-02T23:47:03.715345+0000","last_became_active":"2020-04-02T23:47:03.714083+0000","last_became_peered":"2020-04-02T23:47:03.714083+0000","last_unstale":"2020-04-02T23:47:03.715345+0000","last_undegraded":"2020-04-02T23:47:03.715345+0000","last_fullsized":"2020-04-02T23:47:03.715345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697556+0000","last_change":"2020-04-02T23:46:57.294003+0000","last_active":"2020-04-02T23:47:03.697556+0000","last_peered":"2020-04-02T23:47:03.697556+0000","last_clean":"2020-04-02T23:47:03.697556+0000","last_became_active":"2020-04-02T23:46:57.293787+0000","last_became_peered":"2020-04-02T23:46:57.293787+0000","last_unstale":"2020-04-02T23:47:03.697556+0000","last_undegraded":"2020-04-02T23:47:03.697556+0000","last_fullsized":"2020-04-02T23:47:03.697556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.701887+0000","last_change":"2020-04-02T23:47:00.308297+0000","last_active":"2020-04-02T23:47:03.701887+0000","last_peered":"2020-04-02T23:47:03.701887+0000","last_clean":"2020-04-02T23:47:03.701887+0000","last_became_active":"2020-04-02T23:47:00.307853+0000","last_became_peered":"2020-04-02T23:47:00.307853+0000","last_unstale":"2020-04-02T23:47:03.701887+0000","last_undegraded":"2020-04-02T23:47:03.701887+0000","last_fullsized":"2020-04-02T23:47:03.701887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.716205+0000","last_change":"2020-04-02T23:47:03.715568+0000","last_active":"2020-04-02T23:47:03.716205+0000","last_peered":"2020-04-02T23:47:03.716205+0000","last_clean":"2020-04-02T23:47:03.716205+0000","last_became_active":"2020-04-02T23:47:03.715040+0000","last_became_peered":"2020-04-02T23:47:03.715040+0000","last_unstale":"2020-04-02T23:47:03.716205+0000","last_undegraded":"2020-04-02T23:47:03.716205+0000","last_fullsized":"2020-04-02T23:47:03.716205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697664+0000","last_change":"2020-04-02T23:46:57.295764+0000","last_active":"2020-04-02T23:47:03.697664+0000","last_peered":"2020-04-02T23:47:03.697664+0000","last_clean":"2020-04-02T23:47:03.697664+0000","last_became_active":"2020-04-02T23:46:57.295494+0000","last_became_peered":"2020-04-02T23:46:57.295494+0000","last_unstale":"2020-04-02T23:47:03.697664+0000","last_undegraded":"2020-04-02T23:47:03.697664+0000","last_fullsized":"2020-04-02T23:47:03.697664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716992+0000","last_change":"2020-04-02T23:47:00.305677+0000","last_active":"2020-04-02T23:47:06.716992+0000","last_peered":"2020-04-02T23:47:06.716992+0000","last_clean":"2020-04-02T23:47:06.716992+0000","last_became_active":"2020-04-02T23:47:00.305290+0000","last_became_peered":"2020-04-02T23:47:00.305290+0000","last_unstale":"2020-04-02T23:47:06.716992+0000","last_undegraded":"2020-04-02T23:47:06.716992+0000","last_fullsized":"2020-04-02T23:47:06.716992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.703485+0000","last_change":"2020-04-02T23:47:03.703184+0000","last_active":"2020-04-02T23:47:03.703485+0000","last_peered":"2020-04-02T23:47:03.703485+0000","last_clean":"2020-04-02T23:47:03.703485+0000","last_became_active":"2020-04-02T23:47:03.702684+0000","last_became_peered":"2020-04-02T23:47:03.702684+0000","last_unstale":"2020-04-02T23:47:03.703485+0000","last_undegraded":"2020-04-02T23:47:03.703485+0000","last_fullsized":"2020-04-02T23:47:03.703485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'7","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.716823+0000","last_change":"2020-04-02T23:47:00.306016+0000","last_active":"2020-04-02T23:47:06.716823+0000","last_peered":"2020-04-02T23:47:06.716823+0000","last_clean":"2020-04-02T23:47:06.716823+0000","last_became_active":"2020-04-02T23:47:00.305661+0000","last_became_peered":"2020-04-02T23:47:00.305661+0000","last_unstale":"2020-04-02T23:47:06.716823+0000","last_undegraded":"2020-04-02T23:47:06.716823+0000","last_fullsized":"2020-04-02T23:47:06.716823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702492+0000","last_change":"2020-04-02T23:46:57.713621+0000","last_active":"2020-04-02T23:47:03.702492+0000","last_peered":"2020-04-02T23:47:03.702492+0000","last_clean":"2020-04-02T23:47:03.702492+0000","last_became_active":"2020-04-02T23:46:57.713238+0000","last_became_peered":"2020-04-02T23:46:57.713238+0000","last_unstale":"2020-04-02T23:47:03.702492+0000","last_undegraded":"2020-04-02T23:47:03.702492+0000","last_fullsized":"2020-04-02T23:47:03.702492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.702333+0000","last_change":"2020-04-02T23:47:03.702021+0000","last_active":"2020-04-02T23:47:03.702333+0000","last_peered":"2020-04-02T23:47:03.702333+0000","last_clean":"2020-04-02T23:47:03.702333+0000","last_became_active":"2020-04-02T23:47:03.701495+0000","last_became_peered":"2020-04-02T23:47:03.701495+0000","last_unstale":"2020-04-02T23:47:03.702333+0000","last_undegraded":"2020-04-02T23:47:03.702333+0000","last_fullsized":"2020-04-02T23:47:03.702333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.308721+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.308721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:47:03.697951+0000","last_change":"2020-04-02T23:46:57.713177+0000","last_active":"2020-04-02T23:47:03.697951+0000","last_peered":"2020-04-02T23:47:03.697951+0000","last_clean":"2020-04-02T23:47:03.697951+0000","last_became_active":"2020-04-02T23:46:57.712856+0000","last_became_peered":"2020-04-02T23:46:57.712856+0000","last_unstale":"2020-04-02T23:47:03.697951+0000","last_undegraded":"2020-04-02T23:47:03.697951+0000","last_fullsized":"2020-04-02T23:47:03.697951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:56.281463+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.281463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:47:06.712091+0000","last_change":"2020-04-02T23:47:00.850182+0000","last_active":"2020-04-02T23:47:06.712091+0000","last_peered":"2020-04-02T23:47:06.712091+0000","last_clean":"2020-04-02T23:47:06.712091+0000","last_became_active":"2020-04-02T23:47:00.849643+0000","last_became_peered":"2020-04-02T23:47:00.849643+0000","last_unstale":"2020-04-02T23:47:06.712091+0000","last_undegraded":"2020-04-02T23:47:06.712091+0000","last_fullsized":"2020-04-02T23:47:06.712091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.294480+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.294480+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048880,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322960,"statfs":{"total":96636764160,"available":95562711040,"internally_reserved":1073741824,"allocated":303104,"data_stored":114548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":339.52800000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":112490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":112296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":112862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048864,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322976,"statfs":{"total":96636764160,"available":95562727424,"internally_reserved":1073741824,"allocated":286720,"data_stored":113822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]}]}} 2020-04-02T23:47:21.375 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:21.392 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.547+0000 7fad18d71700 1 Processor -- start 2020-04-02T23:47:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.547+0000 7fad18d71700 1 -- start start 2020-04-02T23:47:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad18d71700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad140a2ab0 0x7fad140aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad18d71700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad14136870 0x7fad140a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad18d71700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad140a5820 con 0x7fad140a4b70 2020-04-02T23:47:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad18d71700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad140a4130 con 0x7fad140a2ab0 2020-04-02T23:47:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad18d71700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad140a43d0 con 0x7fad14136870 2020-04-02T23:47:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad12d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad14136870 0x7fad140a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad12d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad14136870 0x7fad140a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54748/0 (socket says 172.21.15.82:54748) 2020-04-02T23:47:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad12d9d700 1 -- 172.21.15.82:0/1307332929 learned_addr learned my addr 172.21.15.82:0/1307332929 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.548+0000 7fad1259c700 1 --2- 172.21.15.82:0/1307332929 >> v2:172.21.15.50:3300/0 conn(0x7fad140a2ab0 0x7fad140aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 -- 172.21.15.82:0/1307332929 >> v2:172.21.15.50:3300/0 conn(0x7fad140a2ab0 msgr2=0x7fad140aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1307332929 >> v2:172.21.15.50:3300/0 conn(0x7fad140a2ab0 0x7fad140aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 -- 172.21.15.82:0/1307332929 >> v1:172.21.15.50:6789/0 conn(0x7fad140a4b70 legacy=0x7fad14136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 -- 172.21.15.82:0/1307332929 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140a4670 con 0x7fad14136870 2020-04-02T23:47:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1307332929 >> v2:172.21.15.82:3300/0 conn(0x7fad14136870 0x7fad140a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1307332929 >> v2:172.21.15.82:3300/0 conn(0x7fad14136870 0x7fad140a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1307332929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad14136870 0x7fad140a4ff0 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).ready entity=mon.1 client_cookie=8f0d3dfa208d368b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1307332929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad14136870 0x7fad140a4ff0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad1159a700 1 -- 172.21.15.82:0/1307332929 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0c00a160 con 0x7fad14136870 2020-04-02T23:47:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1307332929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad14136870 0x7fad140a4ff0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1307332929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad14136870 0x7fad140a4ff0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad1159a700 1 -- 172.21.15.82:0/1307332929 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c00a2c0 con 0x7fad14136870 2020-04-02T23:47:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad1159a700 1 -- 172.21.15.82:0/1307332929 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0c00a6a0 con 0x7fad14136870 2020-04-02T23:47:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 -- 172.21.15.82:0/1307332929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad14136870 msgr2=0x7fad140a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 --2- 172.21.15.82:0/1307332929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad14136870 0x7fad140a4ff0 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).stop 2020-04-02T23:47:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 -- 172.21.15.82:0/1307332929 shutdown_connections 2020-04-02T23:47:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 --2- 172.21.15.82:0/1307332929 >> v2:172.21.15.50:3300/0 conn(0x7fad140a2ab0 0x7fad140aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 --2- 172.21.15.82:0/1307332929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad14136870 0x7fad140a4ff0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 -- 172.21.15.82:0/1307332929 >> 172.21.15.82:0/1307332929 conn(0x7fad1409de60 msgr2=0x7fad1409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 -- 172.21.15.82:0/1307332929 shutdown_connections 2020-04-02T23:47:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.549+0000 7fad18d71700 1 -- 172.21.15.82:0/1307332929 wait complete. 2020-04-02T23:47:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.550+0000 7fad18d71700 1 Processor -- start 2020-04-02T23:47:21.557 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.550+0000 7fad18d71700 1 -- start start 2020-04-02T23:47:21.560 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad18d71700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad140a2ab0 0x7fad140a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad18d71700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad14136870 0x7fad1414e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad18d71700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad14066990 con 0x7fad140a4b70 2020-04-02T23:47:21.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad18d71700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad14066e80 con 0x7fad14136870 2020-04-02T23:47:21.562 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad18d71700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1409fe80 con 0x7fad140a2ab0 2020-04-02T23:47:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad12d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad14136870 0x7fad1414e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad1259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad140a2ab0 0x7fad140a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad11d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fad140a4b70 0x7fad14138d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58774/0 (socket says 172.21.15.82:58774) 2020-04-02T23:47:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad12d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad14136870 0x7fad1414e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:51336/0 (socket says 172.21.15.82:51336) 2020-04-02T23:47:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad1259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad140a2ab0 0x7fad140a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:50458/0 (socket says 172.21.15.82:50458) 2020-04-02T23:47:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad11d9b700 1 -- 172.21.15.82:0/1642150993 learned_addr learned my addr 172.21.15.82:0/1642150993 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad12d9d700 1 -- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad140a2ab0 msgr2=0x7fad140a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad140a2ab0 0x7fad140a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136895864 0 0) 0x7fad14066990 con 0x7fad140a4b70 2020-04-02T23:47:21.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad12d9d700 1 -- 172.21.15.82:0/1642150993 >> v1:172.21.15.50:6789/0 conn(0x7fad140a4b70 legacy=0x7fad14138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad12d9d700 1 -- 172.21.15.82:0/1642150993 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14061650 con 0x7fad14136870 2020-04-02T23:47:21.564 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.551+0000 7fad1259c700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad140a2ab0 0x7fad140a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:21.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> v2:172.21.15.50:3300/0 conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> v2:172.21.15.50:3300/0 conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0c00a6e0 con 0x7fad14136870 2020-04-02T23:47:21.565 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad140a1a20 con 0x7fad14136870 2020-04-02T23:47:21.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1412cdb0 con 0x7fad14136870 2020-04-02T23:47:21.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c005c30 con 0x7fad14136870 2020-04-02T23:47:21.566 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0c007150 con 0x7fad14136870 2020-04-02T23:47:21.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.552+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fad0c007300 con 0x7fad14136870 2020-04-02T23:47:21.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad0b7fe700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 0x7facf804f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad14061a40 con 0x7fad14136870 2020-04-02T23:47:21.567 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fad0c061b20 con 0x7fad14136870 2020-04-02T23:47:21.568 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad1259c700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 0x7facf804f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.569 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad1259c700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 0x7facf804f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad04007c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.569 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad1259c700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 0x7facf804f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad04007c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.569 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.553+0000 7fad1259c700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 0x7facf804f960 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad04007c50).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.569 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.557+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.569 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.557+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fad0c03d320 con 0x7fad14136870 2020-04-02T23:47:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.694+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad14056c50 con 0x7fad14136870 2020-04-02T23:47:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.695+0000 7fad12d9d700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.695+0000 7fad0b7fe700 1 -- 172.21.15.82:0/1642150993 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fad0c040940 con 0x7fad14136870 2020-04-02T23:47:21.698 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:21.698 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:21.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 msgr2=0x7facf804f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 0x7facf804f960 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad04007c50).stop 2020-04-02T23:47:21.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 msgr2=0x7fad1414e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.699 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fad0c0032b0 tx=0x7fad0c007dc0).stop 2020-04-02T23:47:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 shutdown_connections 2020-04-02T23:47:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7facf804d4a0 0x7facf804f960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14136870 0x7fad1414e530 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 --2- 172.21.15.82:0/1642150993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad140a2ab0 0x7fad140a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 >> 172.21.15.82:0/1642150993 conn(0x7fad1409de60 msgr2=0x7fad14135f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 shutdown_connections 2020-04-02T23:47:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.697+0000 7fad18d71700 1 -- 172.21.15.82:0/1642150993 wait complete. 2020-04-02T23:47:21.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:42.430184+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:55.708328+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:58.921423+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:01.321018+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:47:21.710 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:21.722 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:47:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.868+0000 7f4623805700 1 Processor -- start 2020-04-02T23:47:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4623805700 1 -- start start 2020-04-02T23:47:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4623805700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4623805700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f461c067210 0x7f461c0a6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4623805700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0a2460 con 0x7f461c0a5f90 2020-04-02T23:47:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4623805700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c0a4270 con 0x7f461c067210 2020-04-02T23:47:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4623805700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c0a3b50 con 0x7f461c0a3320 2020-04-02T23:47:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f46215a1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f46215a1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54760/0 (socket says 172.21.15.82:54760) 2020-04-02T23:47:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4620da0700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f461c0a5f90 0x7f461c066b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54810/0 (socket says 172.21.15.82:54810) 2020-04-02T23:47:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f46215a1700 1 -- 172.21.15.82:0/884788772 learned_addr learned my addr 172.21.15.82:0/884788772 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.869+0000 7f4621da2700 1 --2- 172.21.15.82:0/884788772 >> v2:172.21.15.50:3300/0 conn(0x7f461c067210 0x7f461c0a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 -- 172.21.15.82:0/884788772 >> v2:172.21.15.50:3300/0 conn(0x7f461c067210 msgr2=0x7f461c0a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 --2- 172.21.15.82:0/884788772 >> v2:172.21.15.50:3300/0 conn(0x7f461c067210 0x7f461c0a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 -- 172.21.15.82:0/884788772 >> v1:172.21.15.82:6789/0 conn(0x7f461c0a5f90 legacy=0x7f461c066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f460bfff700 1 -- 172.21.15.82:0/884788772 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234776565 0 0) 0x7f461c0a2460 con 0x7f461c0a5f90 2020-04-02T23:47:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 -- 172.21.15.82:0/884788772 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0a5850 con 0x7f461c0a3320 2020-04-02T23:47:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 --2- 172.21.15.82:0/884788772 >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0a4fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f460c002f30 tx=0x7f460c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 --2- 172.21.15.82:0/884788772 >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0a4fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f460c002f30 tx=0x7f460c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 --2- 172.21.15.82:0/884788772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0a4fc0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).ready entity=mon.1 client_cookie=b2fce5712685ea73 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 --2- 172.21.15.82:0/884788772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0a4fc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f460bfff700 1 -- 172.21.15.82:0/884788772 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f460c011670 con 0x7f461c0a3320 2020-04-02T23:47:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 --2- 172.21.15.82:0/884788772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0a4fc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f46215a1700 1 --2- 172.21.15.82:0/884788772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0a4fc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f460bfff700 1 -- 172.21.15.82:0/884788772 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c0117d0 con 0x7f461c0a3320 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f460bfff700 1 -- 172.21.15.82:0/884788772 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f460c011b70 con 0x7f461c0a3320 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 -- 172.21.15.82:0/884788772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 msgr2=0x7f461c0a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 --2- 172.21.15.82:0/884788772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0a4fc0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).stop 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 -- 172.21.15.82:0/884788772 shutdown_connections 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 --2- 172.21.15.82:0/884788772 >> v2:172.21.15.50:3300/0 conn(0x7f461c067210 0x7f461c0a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 --2- 172.21.15.82:0/884788772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0a4fc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 -- 172.21.15.82:0/884788772 >> 172.21.15.82:0/884788772 conn(0x7f461c0ab970 msgr2=0x7f461c0a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 -- 172.21.15.82:0/884788772 shutdown_connections 2020-04-02T23:47:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.870+0000 7f4623805700 1 -- 172.21.15.82:0/884788772 wait complete. 2020-04-02T23:47:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.871+0000 7f4623805700 1 Processor -- start 2020-04-02T23:47:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.871+0000 7f4623805700 1 -- start start 2020-04-02T23:47:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4623805700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f461c067210 0x7f461c0937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4623805700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0915c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4623805700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c090310 con 0x7f461c0a5f90 2020-04-02T23:47:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4623805700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c091d40 con 0x7f461c0a3320 2020-04-02T23:47:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4623805700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c090540 con 0x7f461c067210 2020-04-02T23:47:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0915c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4621da2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f461c0a5f90 0x7f461c0909e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54816/0 (socket says 172.21.15.82:54816) 2020-04-02T23:47:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4621da2700 1 -- 172.21.15.82:0/2617736245 learned_addr learned my addr 172.21.15.82:0/2617736245 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f46215a1700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f461c067210 0x7f461c0937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 -- 172.21.15.82:0/2617736245 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f461c067210 msgr2=0x7f461c0937e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f461c067210 0x7f461c0937e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 -- 172.21.15.82:0/2617736245 >> v1:172.21.15.82:6789/0 conn(0x7f461c0a5f90 legacy=0x7f461c0909e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693982375 0 0) 0x7f461c090310 con 0x7f461c0a5f90 2020-04-02T23:47:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 -- 172.21.15.82:0/2617736245 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c091a20 con 0x7f461c0a3320 2020-04-02T23:47:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f46215a1700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f461c067210 0x7f461c0937e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> v2:172.21.15.82:3300/0 conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461800c970 con 0x7f461c0a3320 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461800cad0 con 0x7f461c0a3320 2020-04-02T23:47:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c0910f0 con 0x7f461c0a3320 2020-04-02T23:47:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.872+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461800ce70 con 0x7f461c0a3320 2020-04-02T23:47:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.873+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c0a9740 con 0x7f461c0a3320 2020-04-02T23:47:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.873+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.873+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f46180044f0 con 0x7f461c0a3320 2020-04-02T23:47:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.873+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.874+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c056c50 con 0x7f461c0a3320 2020-04-02T23:47:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.874+0000 7f460a7fc700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 0x7f45fc04f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.874+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4618060990 con 0x7f461c0a3320 2020-04-02T23:47:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.874+0000 7f46215a1700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 0x7f45fc04f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.874+0000 7f46215a1700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 0x7f45fc04f860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.874+0000 7f46215a1700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 0x7f45fc04f860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.874+0000 7f46215a1700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 0x7f45fc04f860 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:21.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.877+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:21.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:21.877+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f461803c0f0 con 0x7f461c0a3320 2020-04-02T23:47:22.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.014+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f461c091bb0 con 0x7f461c0a3320 2020-04-02T23:47:22.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.014+0000 7f4620da0700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.014+0000 7f460a7fc700 1 -- 172.21.15.82:0/2617736245 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f461803f710 con 0x7f461c0a3320 2020-04-02T23:47:22.017 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2020-04-02T23:47:22.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 msgr2=0x7f45fc04f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 0x7f45fc04f860 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f460c002f30 tx=0x7f460c007a40).stop 2020-04-02T23:47:22.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 msgr2=0x7f461c0915c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f4618000b80 tx=0x7f4618001e40).stop 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 shutdown_connections 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45fc04d3a0 0x7f45fc04f860 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f461c067210 0x7f461c0937e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 --2- 172.21.15.82:0/2617736245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f461c0a3320 0x7f461c0915c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 >> 172.21.15.82:0/2617736245 conn(0x7f461c0ab970 msgr2=0x7f461c068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 shutdown_connections 2020-04-02T23:47:22.019 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.016+0000 7f4623805700 1 -- 172.21.15.82:0/2617736245 wait complete. 2020-04-02T23:47:22.028 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:22.041 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:47:22.189 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.187+0000 7fdfd9f46700 1 Processor -- start 2020-04-02T23:47:22.189 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.187+0000 7fdfd9f46700 1 -- start start 2020-04-02T23:47:22.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd9f46700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfd409f610 0x7fdfd40a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd9f46700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd4135ff0 0x7fdfd4136440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd9f46700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd40a3960 con 0x7fdfd40a8410 2020-04-02T23:47:22.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd9f46700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd40a4890 con 0x7fdfd409f610 2020-04-02T23:47:22.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd9f46700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40a73f0 con 0x7fdfd4135ff0 2020-04-02T23:47:22.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfd409f610 0x7fdfd40a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfd409f610 0x7fdfd40a6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54772/0 (socket says 172.21.15.82:54772) 2020-04-02T23:47:22.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 -- 172.21.15.82:0/2403125317 learned_addr learned my addr 172.21.15.82:0/2403125317 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:22.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd3fff700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd4135ff0 0x7fdfd4136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 -- 172.21.15.82:0/2403125317 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd4135ff0 msgr2=0x7fdfd4136440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd4135ff0 0x7fdfd4136440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 -- 172.21.15.82:0/2403125317 >> v1:172.21.15.50:6789/0 conn(0x7fdfd40a8410 legacy=0x7fdfd40a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 -- 172.21.15.82:0/2403125317 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40a6a40 con 0x7fdfd409f610 2020-04-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/2403125317 >> v2:172.21.15.82:3300/0 conn(0x7fdfd409f610 0x7fdfd40a6e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/2403125317 >> v2:172.21.15.82:3300/0 conn(0x7fdfd409f610 0x7fdfd40a6e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd409f610 0x7fdfd40a6e70 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).ready entity=mon.1 client_cookie=50496073419254d7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd409f610 0x7fdfd40a6e70 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd409f610 0x7fdfd40a6e70 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd27fc700 1 -- 172.21.15.82:0/2403125317 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc8008e10 con 0x7fdfd409f610 2020-04-02T23:47:22.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd409f610 0x7fdfd40a6e70 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd27fc700 1 -- 172.21.15.82:0/2403125317 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc80107c0 con 0x7fdfd409f610 2020-04-02T23:47:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd27fc700 1 -- 172.21.15.82:0/2403125317 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc8010be0 con 0x7fdfd409f610 2020-04-02T23:47:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd9f46700 1 -- 172.21.15.82:0/2403125317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd409f610 msgr2=0x7fdfd40a6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.188+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd409f610 0x7fdfd40a6e70 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).stop 2020-04-02T23:47:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.189+0000 7fdfd9f46700 1 -- 172.21.15.82:0/2403125317 shutdown_connections 2020-04-02T23:47:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.189+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd4135ff0 0x7fdfd4136440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.189+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/2403125317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd409f610 0x7fdfd40a6e70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.189+0000 7fdfd9f46700 1 -- 172.21.15.82:0/2403125317 >> 172.21.15.82:0/2403125317 conn(0x7fdfd40ab970 msgr2=0x7fdfd40a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.189+0000 7fdfd9f46700 1 -- 172.21.15.82:0/2403125317 shutdown_connections 2020-04-02T23:47:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.189+0000 7fdfd9f46700 1 -- 172.21.15.82:0/2403125317 wait complete. 2020-04-02T23:47:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.190+0000 7fdfd9f46700 1 Processor -- start 2020-04-02T23:47:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.190+0000 7fdfd9f46700 1 -- start start 2020-04-02T23:47:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd9f46700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfd409f610 0x7fdfd40639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd9f46700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd9f46700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd4062dc0 con 0x7fdfd4135ff0 2020-04-02T23:47:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd9f46700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd4066c20 con 0x7fdfd409f610 2020-04-02T23:47:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd9f46700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4063020 con 0x7fdfd40a8410 2020-04-02T23:47:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd3fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdfd4135ff0 0x7fdfd4065b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54830/0 (socket says 172.21.15.82:54830) 2020-04-02T23:47:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd3fff700 1 -- 172.21.15.82:0/1966269782 learned_addr learned my addr 172.21.15.82:0/1966269782 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd37fe700 1 --2- 172.21.15.82:0/1966269782 >> v2:172.21.15.50:3300/0 conn(0x7fdfd409f610 0x7fdfd40639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518455538 0 0) 0x7fdfd4062dc0 con 0x7fdfd4135ff0 2020-04-02T23:47:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb4002fe0 con 0x7fdfd4135ff0 2020-04-02T23:47:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4037666954 0 0) 0x7fdfb4002fe0 con 0x7fdfd4135ff0 2020-04-02T23:47:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdfd4062dc0 con 0x7fdfd4135ff0 2020-04-02T23:47:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fdfcc008710 con 0x7fdfd4135ff0 2020-04-02T23:47:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 -- 172.21.15.82:0/1966269782 >> v2:172.21.15.50:3300/0 conn(0x7fdfd409f610 msgr2=0x7fdfd40639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> v2:172.21.15.50:3300/0 conn(0x7fdfd409f610 0x7fdfd40639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 -- 172.21.15.82:0/1966269782 >> v1:172.21.15.82:6789/0 conn(0x7fdfd4135ff0 legacy=0x7fdfd4065b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.210 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 -- 172.21.15.82:0/1966269782 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40632c0 con 0x7fdfd40a8410 2020-04-02T23:47:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd37fe700 1 --2- 172.21.15.82:0/1966269782 >> v2:172.21.15.50:3300/0 conn(0x7fdfd409f610 0x7fdfd40639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc8010e50 con 0x7fdfd40a8410 2020-04-02T23:47:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.191+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.192+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8010c20 con 0x7fdfd40a8410 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.192+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd4063760 con 0x7fdfd40a8410 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.192+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc8007160 con 0x7fdfd40a8410 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.192+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd409dc80 con 0x7fdfd40a8410 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.192+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd409df30 con 0x7fdfd40a8410 2020-04-02T23:47:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdfc80072c0 con 0x7fdfd40a8410 2020-04-02T23:47:22.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd0ff9700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 0x7fdfb40500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdfc8060960 con 0x7fdfd40a8410 2020-04-02T23:47:22.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd37fe700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 0x7fdfb40500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.213 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd37fe700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 0x7fdfb40500a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfd40aadf0 tx=0x7fdfc40013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd37fe700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 0x7fdfb40500a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfd40aadf0 tx=0x7fdfc40013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.193+0000 7fdfd37fe700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 0x7fdfb40500a0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fdfd40aadf0 tx=0x7fdfc40013a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.197+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.214 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.197+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fdfc803c180 con 0x7fdfd40a8410 2020-04-02T23:47:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.336+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdfd4063450 con 0x7fdfd40a8410 2020-04-02T23:47:22.339 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.337+0000 7fdfd2ffd700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.339 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.337+0000 7fdfd0ff9700 1 -- 172.21.15.82:0/1966269782 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdfc803f7a0 con 0x7fdfd40a8410 2020-04-02T23:47:22.339 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:22.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 msgr2=0x7fdfb40500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 0x7fdfb40500a0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fdfd40aadf0 tx=0x7fdfc40013a0).stop 2020-04-02T23:47:22.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 msgr2=0x7fdfd4063e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8007a40).stop 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 shutdown_connections 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdfb404dbe0 0x7fdfb40500a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/1966269782 >> v2:172.21.15.50:3300/0 conn(0x7fdfd409f610 0x7fdfd40639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 --2- 172.21.15.82:0/1966269782 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd40a8410 0x7fdfd4063e50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 >> 172.21.15.82:0/1966269782 conn(0x7fdfd40ab970 msgr2=0x7fdfd40a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 shutdown_connections 2020-04-02T23:47:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.339+0000 7fdfd9f46700 1 -- 172.21.15.82:0/1966269782 wait complete. 2020-04-02T23:47:22.351 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:22.364 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:47:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.510+0000 7fdb4f4d1700 1 Processor -- start 2020-04-02T23:47:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4f4d1700 1 -- start start 2020-04-02T23:47:22.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4f4d1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 0x7fdb480a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4f4d1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb48135ff0 0x7fdb481364a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4f4d1700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb480a3960 con 0x7fdb480a8410 2020-04-02T23:47:22.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4f4d1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480a4890 con 0x7fdb48135ff0 2020-04-02T23:47:22.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4f4d1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480a73f0 con 0x7fdb4809f610 2020-04-02T23:47:22.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4d26d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdb480a8410 0x7fdb480a3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54834/0 (socket says 172.21.15.82:54834) 2020-04-02T23:47:22.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.511+0000 7fdb4d26d700 1 -- 172.21.15.82:0/1977473160 learned_addr learned my addr 172.21.15.82:0/1977473160 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:22.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4da6e700 1 --2- 172.21.15.82:0/1977473160 >> v2:172.21.15.50:3300/0 conn(0x7fdb48135ff0 0x7fdb481364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140402564 0 0) 0x7fdb480a3960 con 0x7fdb480a8410 2020-04-02T23:47:22.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 0x7fdb480a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb30003230 con 0x7fdb480a8410 2020-04-02T23:47:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 965701731 0 0) 0x7fdb30003230 con 0x7fdb480a8410 2020-04-02T23:47:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 msgr2=0x7fdb480a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 0x7fdb480a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 >> v2:172.21.15.50:3300/0 conn(0x7fdb48135ff0 msgr2=0x7fdb481364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 --2- 172.21.15.82:0/1977473160 >> v2:172.21.15.50:3300/0 conn(0x7fdb48135ff0 0x7fdb481364a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480a6a40 con 0x7fdb480a8410 2020-04-02T23:47:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fdb3c0016d0 con 0x7fdb480a8410 2020-04-02T23:47:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 >> v1:172.21.15.82:6789/0 conn(0x7fdb480a8410 legacy=0x7fdb480a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30003720 0x7fdb30003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 0x7fdb30004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480a4890 con 0x7fdb30003720 2020-04-02T23:47:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480a73f0 con 0x7fdb30004060 2020-04-02T23:47:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30005020 con 0x7fdb4809f610 2020-04-02T23:47:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4d26d700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30003720 0x7fdb30003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4da6e700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 0x7fdb30004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 -- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 msgr2=0x7fdb30004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4809f610 0x7fdb30004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 -- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30003720 msgr2=0x7fdb30003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30003720 0x7fdb30003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 -- 172.21.15.82:0/1977473160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb30003230 con 0x7fdb30004060 2020-04-02T23:47:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.512+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).ready entity=mon.1 client_cookie=795460413fa9296 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb44008d30 con 0x7fdb30004060 2020-04-02T23:47:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44008e90 con 0x7fdb30004060 2020-04-02T23:47:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb3bfff700 1 -- 172.21.15.82:0/1977473160 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb44010a80 con 0x7fdb30004060 2020-04-02T23:47:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 msgr2=0x7fdb30004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4f4d1700 1 --2- 172.21.15.82:0/1977473160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb30004060 0x7fdb30004530 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).stop 2020-04-02T23:47:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4da6e700 1 -- 172.21.15.82:0/1977473160 reap_dead start 2020-04-02T23:47:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1977473160 shutdown_connections 2020-04-02T23:47:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1977473160 >> 172.21.15.82:0/1977473160 conn(0x7fdb480ab970 msgr2=0x7fdb480a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1977473160 shutdown_connections 2020-04-02T23:47:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.513+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1977473160 wait complete. 2020-04-02T23:47:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.514+0000 7fdb4f4d1700 1 Processor -- start 2020-04-02T23:47:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.514+0000 7fdb4f4d1700 1 -- start start 2020-04-02T23:47:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4f4d1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb480a5c00 0x7fdb48138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4f4d1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdb48139330 0x7fdb48132b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4f4d1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4813a800 con 0x7fdb48132fd0 2020-04-02T23:47:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4f4d1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480a5580 con 0x7fdb48139330 2020-04-02T23:47:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4f4d1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48066620 con 0x7fdb480a5c00 2020-04-02T23:47:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdb48139330 0x7fdb48132b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdb48139330 0x7fdb48132b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54798/0 (socket says 172.21.15.82:54798) 2020-04-02T23:47:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4d26d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb480a5c00 0x7fdb48138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 -- 172.21.15.82:0/1990748536 learned_addr learned my addr 172.21.15.82:0/1990748536 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 -- 172.21.15.82:0/1990748536 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb480a5c00 msgr2=0x7fdb48138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb480a5c00 0x7fdb48138ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 -- 172.21.15.82:0/1990748536 >> v1:172.21.15.50:6789/0 conn(0x7fdb48132fd0 legacy=0x7fdb481467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 -- 172.21.15.82:0/1990748536 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48136bb0 con 0x7fdb48139330 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> v2:172.21.15.82:3300/0 conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> v2:172.21.15.82:3300/0 conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb3a7fc700 1 -- 172.21.15.82:0/1990748536 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb440056c0 con 0x7fdb48139330 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb3a7fc700 1 -- 172.21.15.82:0/1990748536 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44005820 con 0x7fdb48139330 2020-04-02T23:47:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4813aa30 con 0x7fdb48139330 2020-04-02T23:47:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb3a7fc700 1 -- 172.21.15.82:0/1990748536 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb44005c40 con 0x7fdb48139330 2020-04-02T23:47:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.515+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4813af70 con 0x7fdb48139330 2020-04-02T23:47:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.516+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.516+0000 7fdb3a7fc700 1 -- 172.21.15.82:0/1990748536 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdb4400f1f0 con 0x7fdb48139330 2020-04-02T23:47:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.516+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.516+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48056c50 con 0x7fdb48139330 2020-04-02T23:47:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.517+0000 7fdb3a7fc700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 0x7fdb2804fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.517+0000 7fdb3a7fc700 1 -- 172.21.15.82:0/1990748536 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdb44060e50 con 0x7fdb48139330 2020-04-02T23:47:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.517+0000 7fdb4d26d700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 0x7fdb2804fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.517+0000 7fdb4d26d700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 0x7fdb2804fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb3c0013e0 tx=0x7fdb480a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.517+0000 7fdb4d26d700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 0x7fdb2804fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb3c0013e0 tx=0x7fdb480a87f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.517+0000 7fdb4d26d700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 0x7fdb2804fad0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fdb3c0013e0 tx=0x7fdb480a87f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.520+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.520+0000 7fdb3a7fc700 1 -- 172.21.15.82:0/1990748536 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fdb4403c610 con 0x7fdb48139330 2020-04-02T23:47:22.660 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.658+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb4805d150 con 0x7fdb48139330 2020-04-02T23:47:22.661 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.659+0000 7fdb4ca6c700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.661 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.659+0000 7fdb3a7fc700 1 -- 172.21.15.82:0/1990748536 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdb4403fc30 con 0x7fdb48139330 2020-04-02T23:47:22.661 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 msgr2=0x7fdb2804fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 0x7fdb2804fad0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fdb3c0013e0 tx=0x7fdb480a87f0).stop 2020-04-02T23:47:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 msgr2=0x7fdb48132b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fdb44008910 tx=0x7fdb44010050).stop 2020-04-02T23:47:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 shutdown_connections 2020-04-02T23:47:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdb2804d610 0x7fdb2804fad0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb480a5c00 0x7fdb48138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 --2- 172.21.15.82:0/1990748536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb48139330 0x7fdb48132b70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.664 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 >> 172.21.15.82:0/1990748536 conn(0x7fdb480ab970 msgr2=0x7fdb48068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:22.664 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 shutdown_connections 2020-04-02T23:47:22.664 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.660+0000 7fdb4f4d1700 1 -- 172.21.15.82:0/1990748536 wait complete. 2020-04-02T23:47:22.672 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:22.685 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:47:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.831+0000 7f45ecd45700 1 Processor -- start 2020-04-02T23:47:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.831+0000 7f45ecd45700 1 -- start start 2020-04-02T23:47:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45ecd45700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45ecd45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45e80a6e70 0x7f45e80a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45ecd45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e80a3960 con 0x7f45e8135ff0 2020-04-02T23:47:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45ecd45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e80a73f0 con 0x7f45e80a6e70 2020-04-02T23:47:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45ecd45700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e80a6a40 con 0x7f45e80a8410 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45e80a6e70 0x7f45e80a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e6d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f45e8135ff0 0x7f45e8138f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:58828/0 (socket says 172.21.15.82:58828) 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:50510/0 (socket says 172.21.15.82:50510) 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45e80a6e70 0x7f45e80a3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:51388/0 (socket says 172.21.15.82:51388) 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 -- 172.21.15.82:0/3888309670 learned_addr learned my addr 172.21.15.82:0/3888309670 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 -- 172.21.15.82:0/3888309670 >> v2:172.21.15.50:3300/0 conn(0x7f45e80a6e70 msgr2=0x7f45e80a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 --2- 172.21.15.82:0/3888309670 >> v2:172.21.15.50:3300/0 conn(0x7f45e80a6e70 0x7f45e80a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 -- 172.21.15.82:0/3888309670 >> v1:172.21.15.50:6789/0 conn(0x7f45e8135ff0 legacy=0x7f45e8138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 -- 172.21.15.82:0/3888309670 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e80a7690 con 0x7f45e80a8410 2020-04-02T23:47:22.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.832+0000 7f45e659c700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).ready entity=mon.2 client_cookie=f0e9d2634a438484 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45e659c700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45e5d9b700 1 -- 172.21.15.82:0/3888309670 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d8008e10 con 0x7f45e80a8410 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45e659c700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45e5d9b700 1 -- 172.21.15.82:0/3888309670 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d8010710 con 0x7f45e80a8410 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45e659c700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45e5d9b700 1 -- 172.21.15.82:0/3888309670 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d8010b30 con 0x7f45e80a8410 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 -- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 msgr2=0x7f45e809f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).stop 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 -- 172.21.15.82:0/3888309670 shutdown_connections 2020-04-02T23:47:22.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3888309670 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a8410 0x7f45e809f610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3888309670 >> v2:172.21.15.50:3300/0 conn(0x7f45e80a6e70 0x7f45e80a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:22.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 -- 172.21.15.82:0/3888309670 >> 172.21.15.82:0/3888309670 conn(0x7f45e80ab970 msgr2=0x7f45e80a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:22.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 -- 172.21.15.82:0/3888309670 shutdown_connections 2020-04-02T23:47:22.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.833+0000 7f45ecd45700 1 -- 172.21.15.82:0/3888309670 wait complete. 2020-04-02T23:47:22.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.834+0000 7f45ecd45700 1 Processor -- start 2020-04-02T23:47:22.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.834+0000 7f45ecd45700 1 -- start start 2020-04-02T23:47:22.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45ecd45700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45ecd45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45e8135ff0 0x7f45e809faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45ecd45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e80aa410 con 0x7f45e80a8410 2020-04-02T23:47:22.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45ecd45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e8142140 con 0x7f45e8135ff0 2020-04-02T23:47:22.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45ecd45700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e809ff00 con 0x7f45e80a6e70 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45dffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f45e80a8410 0x7f45e809de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54862/0 (socket says 172.21.15.82:54862) 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45dffff700 1 -- 172.21.15.82:0/3661837737 learned_addr learned my addr 172.21.15.82:0/3661837737 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e6d9d700 1 --2- 172.21.15.82:0/3661837737 >> v2:172.21.15.50:3300/0 conn(0x7f45e8135ff0 0x7f45e809faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774641937 0 0) 0x7f45e80aa410 con 0x7f45e80a8410 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45cc002fe0 con 0x7f45e80a8410 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 -- 172.21.15.82:0/3661837737 >> v2:172.21.15.50:3300/0 conn(0x7f45e8135ff0 msgr2=0x7f45e809faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> v2:172.21.15.50:3300/0 conn(0x7f45e8135ff0 0x7f45e809faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 -- 172.21.15.82:0/3661837737 >> v1:172.21.15.82:6789/0 conn(0x7f45e80a8410 legacy=0x7f45e809de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 -- 172.21.15.82:0/3661837737 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e809d750 con 0x7f45e80a6e70 2020-04-02T23:47:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d800f8a0 con 0x7f45e80a6e70 2020-04-02T23:47:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e809d9f0 con 0x7f45e80a6e70 2020-04-02T23:47:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d8007160 con 0x7f45e80a6e70 2020-04-02T23:47:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.835+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d8007580 con 0x7f45e80a6e70 2020-04-02T23:47:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.836+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e809bac0 con 0x7f45e80a6e70 2020-04-02T23:47:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.836+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e809c400 con 0x7f45e80a6e70 2020-04-02T23:47:22.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f45d80056c0 con 0x7f45e80a6e70 2020-04-02T23:47:22.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45df7fe700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 0x7f45cc04fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:22.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f45d8061010 con 0x7f45e80a6e70 2020-04-02T23:47:22.848 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45dffff700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 0x7f45cc04fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45dffff700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 0x7f45cc04fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45d0002f30 tx=0x7f45d00090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45dffff700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 0x7f45cc04fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45d0002f30 tx=0x7f45d00090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.837+0000 7f45dffff700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 0x7f45cc04fd50 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f45d0002f30 tx=0x7f45d00090b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.841+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.841+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f45d803c730 con 0x7f45e80a6e70 2020-04-02T23:47:22.981 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.979+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45e8056c50 con 0x7f45e80a6e70 2020-04-02T23:47:22.981 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.979+0000 7f45e659c700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:22.981 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.979+0000 7f45df7fe700 1 -- 172.21.15.82:0/3661837737 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f45d803fd50 con 0x7f45e80a6e70 2020-04-02T23:47:22.982 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:22.983 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 msgr2=0x7f45cc04fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.983 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 0x7f45cc04fd50 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f45d0002f30 tx=0x7f45d00090b0).stop 2020-04-02T23:47:22.983 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 msgr2=0x7f45e809c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:22.983 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f45d8002f30 tx=0x7f45d8007a40).stop 2020-04-02T23:47:22.984 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 shutdown_connections 2020-04-02T23:47:22.984 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3661837737 >> v2:172.21.15.50:3300/0 conn(0x7f45e8135ff0 0x7f45e809faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.984 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45e80a6e70 0x7f45e809c6e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.984 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 --2- 172.21.15.82:0/3661837737 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f45cc04d890 0x7f45cc04fd50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:22.984 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 >> 172.21.15.82:0/3661837737 conn(0x7f45e80ab970 msgr2=0x7f45e80a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:22.985 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 shutdown_connections 2020-04-02T23:47:22.985 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:22.981+0000 7f45ecd45700 1 -- 172.21.15.82:0/3661837737 wait complete. 2020-04-02T23:47:22.993 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:23.006 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:47:23.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.148+0000 7f96555a3700 1 Processor -- start 2020-04-02T23:47:23.151 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.148+0000 7f96555a3700 1 -- start start 2020-04-02T23:47:23.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.149+0000 7f96555a3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f965005f730 0x7f9650060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.149+0000 7f96555a3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96500628e0 con 0x7f9650140970 2020-04-02T23:47:23.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.149+0000 7f96555a3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9650062b10 con 0x7f965005c3a0 2020-04-02T23:47:23.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.149+0000 7f96555a3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500a95a0 con 0x7f965005f730 2020-04-02T23:47:23.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.149+0000 7f964effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f965005c3a0 0x7f965005f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54868/0 (socket says 172.21.15.82:54868) 2020-04-02T23:47:23.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.149+0000 7f964effd700 1 -- 172.21.15.82:0/979384811 learned_addr learned my addr 172.21.15.82:0/979384811 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:23.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964e7fc700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f965005f730 0x7f9650060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.169 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107237922 0 0) 0x7f9650062b10 con 0x7f965005c3a0 2020-04-02T23:47:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9630003230 con 0x7f965005c3a0 2020-04-02T23:47:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895258008 0 0) 0x7f96500628e0 con 0x7f9650140970 2020-04-02T23:47:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9650062b10 con 0x7f9650140970 2020-04-02T23:47:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2594969397 0 0) 0x7f9630003230 con 0x7f965005c3a0 2020-04-02T23:47:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f965005f730 msgr2=0x7f9650060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f965005f730 0x7f9650060cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 >> v1:172.21.15.50:6789/0 conn(0x7f9650140970 legacy=0x7f9650142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500a9770 con 0x7f965005c3a0 2020-04-02T23:47:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f96380016d0 con 0x7f965005c3a0 2020-04-02T23:47:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 >> v1:172.21.15.82:6789/0 conn(0x7f965005c3a0 legacy=0x7f965005f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96300038b0 0x7f9630003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96300044d0 0x7f9630004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96300052f0 con 0x7f96300044d0 2020-04-02T23:47:23.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963000bb80 con 0x7f9630004db0 2020-04-02T23:47:23.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963000bcc0 con 0x7f96300038b0 2020-04-02T23:47:23.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964e7fc700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f965005f730 0x7f9650060cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:23.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964effd700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96300038b0 0x7f9630003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.172 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964e7fc700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96300044d0 0x7f9630004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.177 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 -- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96300038b0 msgr2=0x7f9630003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f96300038b0 0x7f9630003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 -- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96300044d0 msgr2=0x7f9630004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96300044d0 0x7f9630004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 -- 172.21.15.82:0/979384811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630003230 con 0x7f9630004db0 2020-04-02T23:47:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964e7fc700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96300044d0 0x7f9630004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9648001450 tx=0x7f9648001910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9648001450 tx=0x7f9648001910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.150+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f9648001450 tx=0x7f9648001910).ready entity=mon.1 client_cookie=1f96bcc8c42dcf28 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f9648001450 tx=0x7f9648001910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9648001dc0 con 0x7f9630004db0 2020-04-02T23:47:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f9648001450 tx=0x7f9648001910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f964f7fe700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f9648001450 tx=0x7f9648001910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964800cdd0 con 0x7f9630004db0 2020-04-02T23:47:23.182 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f964dffb700 1 -- 172.21.15.82:0/979384811 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96480114c0 con 0x7f9630004db0 2020-04-02T23:47:23.182 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f96555a3700 1 -- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 msgr2=0x7f963000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.183 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f96555a3700 1 --2- 172.21.15.82:0/979384811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9630004db0 0x7f963000b720 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f9648001450 tx=0x7f9648001910).stop 2020-04-02T23:47:23.183 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f964f7fe700 1 -- 172.21.15.82:0/979384811 reap_dead start 2020-04-02T23:47:23.183 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f96555a3700 1 -- 172.21.15.82:0/979384811 shutdown_connections 2020-04-02T23:47:23.183 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f96555a3700 1 -- 172.21.15.82:0/979384811 >> 172.21.15.82:0/979384811 conn(0x7f96500aa630 msgr2=0x7f96500ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:23.183 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f96555a3700 1 -- 172.21.15.82:0/979384811 shutdown_connections 2020-04-02T23:47:23.183 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.151+0000 7f96555a3700 1 -- 172.21.15.82:0/979384811 wait complete. 2020-04-02T23:47:23.185 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.152+0000 7f96555a3700 1 Processor -- start 2020-04-02T23:47:23.185 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.152+0000 7f96555a3700 1 -- start start 2020-04-02T23:47:23.185 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f96555a3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9650064c40 0x7f9650146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.186 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f96555a3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96500a2750 0x7f96501469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.186 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f96555a3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96500a51b0 con 0x7f96500a31d0 2020-04-02T23:47:23.186 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f96555a3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96500a5450 con 0x7f96500a2750 2020-04-02T23:47:23.190 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f96555a3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96500a56f0 con 0x7f9650064c40 2020-04-02T23:47:23.190 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9650064c40 0x7f9650146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.190 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9650064c40 0x7f9650146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54830/0 (socket says 172.21.15.82:54830) 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 -- 172.21.15.82:0/1912441811 learned_addr learned my addr 172.21.15.82:0/1912441811 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964f7fe700 1 --2- 172.21.15.82:0/1912441811 >> v2:172.21.15.50:3300/0 conn(0x7f96500a2750 0x7f96501469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 -- 172.21.15.82:0/1912441811 >> v2:172.21.15.50:3300/0 conn(0x7f96500a2750 msgr2=0x7f96501469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> v2:172.21.15.50:3300/0 conn(0x7f96500a2750 0x7f96501469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 -- 172.21.15.82:0/1912441811 >> v1:172.21.15.50:6789/0 conn(0x7f96500a31d0 legacy=0x7f96500a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 -- 172.21.15.82:0/1912441811 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500a2b90 con 0x7f9650064c40 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> v2:172.21.15.82:3300/0 conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> v2:172.21.15.82:3300/0 conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f9647fff700 1 -- 172.21.15.82:0/1912441811 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9638012c60 con 0x7f9650064c40 2020-04-02T23:47:23.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f9647fff700 1 -- 172.21.15.82:0/1912441811 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9638012e00 con 0x7f9650064c40 2020-04-02T23:47:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9650146e20 con 0x7f9650064c40 2020-04-02T23:47:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f9647fff700 1 -- 172.21.15.82:0/1912441811 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f963800c8f0 con 0x7f9650064c40 2020-04-02T23:47:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.153+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96500a3b20 con 0x7f9650064c40 2020-04-02T23:47:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.154+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.154+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9650056c50 con 0x7f9650064c40 2020-04-02T23:47:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.154+0000 7f9647fff700 1 -- 172.21.15.82:0/1912441811 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f963800cb20 con 0x7f9650064c40 2020-04-02T23:47:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.154+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.155+0000 7f9647fff700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 0x7f963404fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.155+0000 7f9647fff700 1 -- 172.21.15.82:0/1912441811 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9638061240 con 0x7f9650064c40 2020-04-02T23:47:23.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.155+0000 7f964e7fc700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 0x7f963404fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.155+0000 7f964e7fc700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 0x7f963404fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f965013fd30 tx=0x7f964000c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.155+0000 7f964e7fc700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 0x7f963404fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f965013fd30 tx=0x7f964000c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.155+0000 7f964e7fc700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 0x7f963404fa70 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f965013fd30 tx=0x7f964000c830).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.195 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.158+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.195 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.158+0000 7f9647fff700 1 -- 172.21.15.82:0/1912441811 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f963803c940 con 0x7f9650064c40 2020-04-02T23:47:23.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.339+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96500aaa40 con 0x7f9650064c40 2020-04-02T23:47:23.341 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.339+0000 7f964effd700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.339+0000 7f9647fff700 1 -- 172.21.15.82:0/1912441811 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f963803ff60 con 0x7f9650064c40 2020-04-02T23:47:23.342 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:47:07.704695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:47:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 msgr2=0x7f963404fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 0x7f963404fa70 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f965013fd30 tx=0x7f964000c830).stop 2020-04-02T23:47:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 msgr2=0x7f9650146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f96380014a0 tx=0x7f96500a9900).stop 2020-04-02T23:47:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 shutdown_connections 2020-04-02T23:47:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f963404d5b0 0x7f963404fa70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 --2- 172.21.15.82:0/1912441811 >> v2:172.21.15.50:3300/0 conn(0x7f96500a2750 0x7f96501469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 --2- 172.21.15.82:0/1912441811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9650064c40 0x7f9650146560 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 >> 172.21.15.82:0/1912441811 conn(0x7f96500aa630 msgr2=0x7f9650068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 shutdown_connections 2020-04-02T23:47:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.341+0000 7f96555a3700 1 -- 172.21.15.82:0/1912441811 wait complete. 2020-04-02T23:47:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2020-04-02T23:47:23.353 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:23.366 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.509+0000 7fd626c98700 1 Processor -- start 2020-04-02T23:47:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.509+0000 7fd626c98700 1 -- start start 2020-04-02T23:47:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd626c98700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 0x7fd6200aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd626c98700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd620136870 0x7fd6200a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd626c98700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6200a5820 con 0x7fd6200a4b70 2020-04-02T23:47:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd626c98700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200a4130 con 0x7fd620136870 2020-04-02T23:47:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd626c98700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200a43d0 con 0x7fd6200a2ab0 2020-04-02T23:47:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd61ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6200a4b70 0x7fd620136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54888/0 (socket says 172.21.15.82:54888) 2020-04-02T23:47:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd61ffff700 1 -- 172.21.15.82:0/1050471437 learned_addr learned my addr 172.21.15.82:0/1050471437 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd624a34700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 0x7fd6200aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd625235700 1 --2- 172.21.15.82:0/1050471437 >> v2:172.21.15.50:3300/0 conn(0x7fd620136870 0x7fd6200a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251050503 0 0) 0x7fd6200a5820 con 0x7fd6200a4b70 2020-04-02T23:47:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.510+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd60c003230 con 0x7fd6200a4b70 2020-04-02T23:47:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3810076845 0 0) 0x7fd60c003230 con 0x7fd6200a4b70 2020-04-02T23:47:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 msgr2=0x7fd6200aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 0x7fd6200aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 >> v2:172.21.15.50:3300/0 conn(0x7fd620136870 msgr2=0x7fd6200a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 --2- 172.21.15.82:0/1050471437 >> v2:172.21.15.50:3300/0 conn(0x7fd620136870 0x7fd6200a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200a4670 con 0x7fd6200a4b70 2020-04-02T23:47:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fd6140016d0 con 0x7fd6200a4b70 2020-04-02T23:47:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 >> v1:172.21.15.82:6789/0 conn(0x7fd6200a4b70 legacy=0x7fd620136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c003720 0x7fd60c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 0x7fd60c004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200a4130 con 0x7fd60c003720 2020-04-02T23:47:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200a43d0 con 0x7fd60c004060 2020-04-02T23:47:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c004ff0 con 0x7fd6200a2ab0 2020-04-02T23:47:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd624a34700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c003720 0x7fd60c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd625235700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 0x7fd60c004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 -- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 msgr2=0x7fd60c004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6200a2ab0 0x7fd60c004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 -- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c003720 msgr2=0x7fd60c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c003720 0x7fd60c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 -- 172.21.15.82:0/1050471437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c003230 con 0x7fd60c004060 2020-04-02T23:47:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).ready entity=mon.1 client_cookie=c1c2281edcaa8b8d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61400ce70 con 0x7fd60c004060 2020-04-02T23:47:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61ffff700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61400e350 con 0x7fd60c004060 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd61f7fe700 1 -- 172.21.15.82:0/1050471437 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61400e770 con 0x7fd60c004060 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd626c98700 1 -- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 msgr2=0x7fd60c004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd626c98700 1 --2- 172.21.15.82:0/1050471437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c004060 0x7fd60c004530 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).stop 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.511+0000 7fd625235700 1 -- 172.21.15.82:0/1050471437 reap_dead start 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.512+0000 7fd626c98700 1 -- 172.21.15.82:0/1050471437 shutdown_connections 2020-04-02T23:47:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.512+0000 7fd626c98700 1 -- 172.21.15.82:0/1050471437 >> 172.21.15.82:0/1050471437 conn(0x7fd62009de60 msgr2=0x7fd62009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.512+0000 7fd626c98700 1 -- 172.21.15.82:0/1050471437 shutdown_connections 2020-04-02T23:47:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.512+0000 7fd626c98700 1 -- 172.21.15.82:0/1050471437 wait complete. 2020-04-02T23:47:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.513+0000 7fd626c98700 1 Processor -- start 2020-04-02T23:47:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.513+0000 7fd626c98700 1 -- start start 2020-04-02T23:47:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.513+0000 7fd626c98700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd620065c50 0x7fd620132010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.513+0000 7fd626c98700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6200673b0 con 0x7fd620132470 2020-04-02T23:47:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.513+0000 7fd626c98700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd620065550 con 0x7fd620066660 2020-04-02T23:47:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.513+0000 7fd626c98700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200657b0 con 0x7fd620065c50 2020-04-02T23:47:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd620065c50 0x7fd620132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd620065c50 0x7fd620132010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54852/0 (socket says 172.21.15.82:54852) 2020-04-02T23:47:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd624a34700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd620066660 0x7fd6200635e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54900/0 (socket says 172.21.15.82:54900) 2020-04-02T23:47:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 -- 172.21.15.82:0/2265619585 learned_addr learned my addr 172.21.15.82:0/2265619585 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 -- 172.21.15.82:0/2265619585 >> v1:172.21.15.82:6789/0 conn(0x7fd620066660 legacy=0x7fd6200635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 -- 172.21.15.82:0/2265619585 >> v1:172.21.15.50:6789/0 conn(0x7fd620132470 legacy=0x7fd6201511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21790107 0 0) 0x7fd620065550 con 0x7fd620066660 2020-04-02T23:47:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 -- 172.21.15.82:0/2265619585 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620063cf0 con 0x7fd620065c50 2020-04-02T23:47:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> v2:172.21.15.82:3300/0 conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> v2:172.21.15.82:3300/0 conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61400e720 con 0x7fd620065c50 2020-04-02T23:47:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6140045b0 con 0x7fd620065c50 2020-04-02T23:47:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6200a1d40 con 0x7fd620065c50 2020-04-02T23:47:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd614004930 con 0x7fd620065c50 2020-04-02T23:47:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.514+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6200618e0 con 0x7fd620065c50 2020-04-02T23:47:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.515+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.515+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6200a1b90 con 0x7fd620065c50 2020-04-02T23:47:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.515+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd614004a90 con 0x7fd620065c50 2020-04-02T23:47:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.515+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.515+0000 7fd61dffb700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 0x7fd60004f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.515+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd614061410 con 0x7fd620065c50 2020-04-02T23:47:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.515+0000 7fd624a34700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 0x7fd60004f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.516+0000 7fd624a34700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 0x7fd60004f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd610002ed0 tx=0x7fd61000c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.516+0000 7fd624a34700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 0x7fd60004f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd610002ed0 tx=0x7fd61000c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.516+0000 7fd624a34700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 0x7fd60004f8a0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fd610002ed0 tx=0x7fd61000c770).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.519+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.543 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.519+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd61403cc30 con 0x7fd620065c50 2020-04-02T23:47:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.656+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd620056c50 con 0x7fd620065c50 2020-04-02T23:47:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.657+0000 7fd61ffff700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.657+0000 7fd61dffb700 1 -- 172.21.15.82:0/2265619585 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd614040250 con 0x7fd620065c50 2020-04-02T23:47:23.659 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:23.660 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:23.661 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.658+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 msgr2=0x7fd60004f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.661 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.658+0000 7fd626c98700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 0x7fd60004f8a0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fd610002ed0 tx=0x7fd61000c770).stop 2020-04-02T23:47:23.661 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 msgr2=0x7fd620132010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.661 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fd6140013e0 tx=0x7fd6200a2e90).stop 2020-04-02T23:47:23.661 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 shutdown_connections 2020-04-02T23:47:23.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd60004d3e0 0x7fd60004f8a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 --2- 172.21.15.82:0/2265619585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd620065c50 0x7fd620132010 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 >> 172.21.15.82:0/2265619585 conn(0x7fd62009de60 msgr2=0x7fd6200a82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:23.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 shutdown_connections 2020-04-02T23:47:23.662 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.659+0000 7fd626c98700 1 -- 172.21.15.82:0/2265619585 wait complete. 2020-04-02T23:47:23.671 DEBUG:tasks.mds_thrash:Yielding 2020-04-02T23:47:23.671 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-04-02T23:47:23.693 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-04-02T23:47:23.694 INFO:tasks.ceph_fuse:config is None 2020-04-02T23:47:23.694 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-04-02T23:47:23.694 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-04-02T23:47:23.694 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:23.695 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2020-04-02T23:47:23.695 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 112 secs before thrashing 2020-04-02T23:47:23.709 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:47:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.855+0000 7f38315e3700 1 Processor -- start 2020-04-02T23:47:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.855+0000 7f38315e3700 1 -- start start 2020-04-02T23:47:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.855+0000 7f38315e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c140750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.855+0000 7f38315e3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c147630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.855+0000 7f38315e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c0a55d0 con 0x7f382c0a3480 2020-04-02T23:47:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.855+0000 7f38315e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0a70f0 con 0x7f382c0a6b90 2020-04-02T23:47:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.855+0000 7f38315e3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0a5800 con 0x7f382c140bb0 2020-04-02T23:47:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c140750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54862/0 (socket says 172.21.15.82:54862) 2020-04-02T23:47:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 -- 172.21.15.82:0/3866445056 learned_addr learned my addr 172.21.15.82:0/3866445056 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f3830de2700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 -- 172.21.15.82:0/3866445056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 msgr2=0x7f382c147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 -- 172.21.15.82:0/3866445056 >> v1:172.21.15.50:6789/0 conn(0x7f382c0a3480 legacy=0x7f382c0a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 -- 172.21.15.82:0/3866445056 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c0a4f30 con 0x7f382c0a6b90 2020-04-02T23:47:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f3830de2700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- 172.21.15.82:0/3866445056 >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c140750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f382c05c8c0 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- 172.21.15.82:0/3866445056 >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c140750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f382c05c8c0 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c140750 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f382c05c8c0 tx=0x7f3820007a40).ready entity=mon.1 client_cookie=c20a807476c7d50e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c140750 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f382c05c8c0 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c140750 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f382c05c8c0 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382affd700 1 -- 172.21.15.82:0/3866445056 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38200116e0 con 0x7f382c0a6b90 2020-04-02T23:47:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382b7fe700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c140750 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f382c05c8c0 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382affd700 1 -- 172.21.15.82:0/3866445056 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820011840 con 0x7f382c0a6b90 2020-04-02T23:47:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f382affd700 1 -- 172.21.15.82:0/3866445056 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3820011c60 con 0x7f382c0a6b90 2020-04-02T23:47:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f38315e3700 1 -- 172.21.15.82:0/3866445056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 msgr2=0x7f382c140750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.856+0000 7f38315e3700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c140750 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f382c05c8c0 tx=0x7f3820007a40).stop 2020-04-02T23:47:23.870 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.857+0000 7f38315e3700 1 -- 172.21.15.82:0/3866445056 shutdown_connections 2020-04-02T23:47:23.870 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.857+0000 7f38315e3700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:23.870 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.857+0000 7f38315e3700 1 --2- 172.21.15.82:0/3866445056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c140750 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.857+0000 7f38315e3700 1 -- 172.21.15.82:0/3866445056 >> 172.21.15.82:0/3866445056 conn(0x7f382c09de60 msgr2=0x7f382c09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.857+0000 7f38315e3700 1 -- 172.21.15.82:0/3866445056 shutdown_connections 2020-04-02T23:47:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.857+0000 7f38315e3700 1 -- 172.21.15.82:0/3866445056 wait complete. 2020-04-02T23:47:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f38315e3700 1 Processor -- start 2020-04-02T23:47:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f38315e3700 1 -- start start 2020-04-02T23:47:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f38315e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f38315e3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c0a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f38315e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c0a16b0 con 0x7f382c0a3480 2020-04-02T23:47:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f38315e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0a1950 con 0x7f382c0a6b90 2020-04-02T23:47:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f38315e3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c13bf70 con 0x7f382c140bb0 2020-04-02T23:47:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f382b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f382b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54866/0 (socket says 172.21.15.82:54866) 2020-04-02T23:47:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.858+0000 7f382b7fe700 1 -- 172.21.15.82:0/426464772 learned_addr learned my addr 172.21.15.82:0/426464772 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f3830de2700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c0a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 -- 172.21.15.82:0/426464772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 msgr2=0x7f382c0a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c0a1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 -- 172.21.15.82:0/426464772 >> v1:172.21.15.50:6789/0 conn(0x7f382c0a3480 legacy=0x7f382c134820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 -- 172.21.15.82:0/426464772 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c0a9d70 con 0x7f382c0a6b90 2020-04-02T23:47:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> v2:172.21.15.82:3300/0 conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f38297fa700 1 -- 172.21.15.82:0/426464772 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3820007150 con 0x7f382c0a6b90 2020-04-02T23:47:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f38297fa700 1 -- 172.21.15.82:0/426464772 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200072b0 con 0x7f382c0a6b90 2020-04-02T23:47:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c134f30 con 0x7f382c0a6b90 2020-04-02T23:47:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f38297fa700 1 -- 172.21.15.82:0/426464772 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38200056c0 con 0x7f382c0a6b90 2020-04-02T23:47:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.859+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c0a98d0 con 0x7f382c0a6b90 2020-04-02T23:47:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.860+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.860+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c056c50 con 0x7f382c0a6b90 2020-04-02T23:47:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.860+0000 7f38297fa700 1 -- 172.21.15.82:0/426464772 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3820005930 con 0x7f382c0a6b90 2020-04-02T23:47:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.860+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.860+0000 7f38297fa700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 0x7f380c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.860+0000 7f38297fa700 1 -- 172.21.15.82:0/426464772 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3820061570 con 0x7f382c0a6b90 2020-04-02T23:47:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.860+0000 7f382bfff700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 0x7f380c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.861+0000 7f382bfff700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 0x7f380c04fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f381c001f50 tx=0x7f381c002480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.861+0000 7f382bfff700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 0x7f380c04fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f381c001f50 tx=0x7f381c002480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.861+0000 7f382bfff700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 0x7f380c04fa90 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f381c001f50 tx=0x7f381c002480).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.864+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:23.864+0000 7f38297fa700 1 -- 172.21.15.82:0/426464772 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f382003cd90 con 0x7f382c0a6b90 2020-04-02T23:47:24.002 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.000+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f382c056c50 con 0x7f382c0a6b90 2020-04-02T23:47:24.003 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.001+0000 7f382b7fe700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.003 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.001+0000 7f38297fa700 1 -- 172.21.15.82:0/426464772 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f38200403b0 con 0x7f382c0a6b90 2020-04-02T23:47:24.003 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:24.003 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"9ad11b85-09ab-48b2-ad7c-5536462abc65","created":"2020-04-02T23:46:39.466861+0000","modified":"2020-04-02T23:47:04.695631+0000","last_up_change":"2020-04-02T23:46:51.255704+0000","last_in_change":"2020-04-02T23:46:51.255704+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:46:42.430184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:46:55.708328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:46:58.921423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:47:01.321018+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2217a33-18df-4a82-9499-c9325111dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":24843},{"type":"v1","addr":"172.21.15.82:6803","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":24843},{"type":"v1","addr":"172.21.15.82:6805","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":24843},{"type":"v1","addr":"172.21.15.82:6809","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":24843},{"type":"v1","addr":"172.21.15.82:6807","nonce":24843}]},"public_addr":"172.21.15.82:6803/24843","cluster_addr":"172.21.15.82:6805/24843","heartbeat_back_addr":"172.21.15.82:6809/24843","heartbeat_front_addr":"172.21.15.82:6807/24843","state":["exists","up"]},{"osd":1,"uuid":"e604193e-ce17-4f9c-aa8d-03e9bec4eeed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":24884},{"type":"v1","addr":"172.21.15.82:6811","nonce":24884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":24884},{"type":"v1","addr":"172.21.15.82:6813","nonce":24884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":24884},{"type":"v1","addr":"172.21.15.82:6817","nonce":24884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":24884},{"type":"v1","addr":"172.21.15.82:6815","nonce":24884}]},"public_addr":"172.21.15.82:6811/24884","cluster_addr":"172.21.15.82:6813/24884","heartbeat_back_addr":"172.21.15.82:6817/24884","heartbeat_front_addr":"172.21.15.82:6815/24884","state":["exists","up"]},{"osd":2,"uuid":"7d86b9f5-68ed-4aa3-8d18-50cd25f5e72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":24937},{"type":"v1","addr":"172.21.15.82:6819","nonce":24937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":24937},{"type":"v1","addr":"172.21.15.82:6821","nonce":24937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":24937},{"type":"v1","addr":"172.21.15.82:6825","nonce":24937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":24937},{"type":"v1","addr":"172.21.15.82:6823","nonce":24937}]},"public_addr":"172.21.15.82:6819/24937","cluster_addr":"172.21.15.82:6821/24937","heartbeat_back_addr":"172.21.15.82:6825/24937","heartbeat_front_addr":"172.21.15.82:6823/24937","state":["exists","up"]},{"osd":3,"uuid":"295c5ad2-22bd-4fc6-8c27-898b1cf61412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":24965},{"type":"v1","addr":"172.21.15.82:6827","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":24965},{"type":"v1","addr":"172.21.15.82:6829","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24965},{"type":"v1","addr":"172.21.15.82:6833","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":24965},{"type":"v1","addr":"172.21.15.82:6831","nonce":24965}]},"public_addr":"172.21.15.82:6827/24965","cluster_addr":"172.21.15.82:6829/24965","heartbeat_back_addr":"172.21.15.82:6833/24965","heartbeat_front_addr":"172.21.15.82:6831/24965","state":["exists","up"]},{"osd":4,"uuid":"31998e05-06a4-4dbe-b0e5-6d4c4ab7787b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":24224},{"type":"v1","addr":"172.21.15.50:6801","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":24224},{"type":"v1","addr":"172.21.15.50:6803","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":24224},{"type":"v1","addr":"172.21.15.50:6807","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":24224},{"type":"v1","addr":"172.21.15.50:6805","nonce":24224}]},"public_addr":"172.21.15.50:6801/24224","cluster_addr":"172.21.15.50:6803/24224","heartbeat_back_addr":"172.21.15.50:6807/24224","heartbeat_front_addr":"172.21.15.50:6805/24224","state":["exists","up"]},{"osd":5,"uuid":"7119fccd-946f-459f-9043-0ed28fa226fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":24272},{"type":"v1","addr":"172.21.15.50:6809","nonce":24272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":24272},{"type":"v1","addr":"172.21.15.50:6811","nonce":24272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":24272},{"type":"v1","addr":"172.21.15.50:6815","nonce":24272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":24272},{"type":"v1","addr":"172.21.15.50:6813","nonce":24272}]},"public_addr":"172.21.15.50:6809/24272","cluster_addr":"172.21.15.50:6811/24272","heartbeat_back_addr":"172.21.15.50:6815/24272","heartbeat_front_addr":"172.21.15.50:6813/24272","state":["exists","up"]},{"osd":6,"uuid":"c6f6c1e1-951d-41de-86f8-d782b8879e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":24303},{"type":"v1","addr":"172.21.15.50:6817","nonce":24303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":24303},{"type":"v1","addr":"172.21.15.50:6819","nonce":24303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":24303},{"type":"v1","addr":"172.21.15.50:6823","nonce":24303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":24303},{"type":"v1","addr":"172.21.15.50:6821","nonce":24303}]},"public_addr":"172.21.15.50:6817/24303","cluster_addr":"172.21.15.50:6819/24303","heartbeat_back_addr":"172.21.15.50:6823/24303","heartbeat_front_addr":"172.21.15.50:6821/24303","state":["exists","up"]},{"osd":7,"uuid":"5861a0cf-ae82-4888-9623-e5c9a636d664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":24325},{"type":"v1","addr":"172.21.15.50:6825","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":24325},{"type":"v1","addr":"172.21.15.50:6827","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":24325},{"type":"v1","addr":"172.21.15.50:6831","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":24325},{"type":"v1","addr":"172.21.15.50:6829","nonce":24325}]},"public_addr":"172.21.15.50:6825/24325","cluster_addr":"172.21.15.50:6827/24325","heartbeat_back_addr":"172.21.15.50:6831/24325","heartbeat_front_addr":"172.21.15.50:6829/24325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.610848+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.701732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.759249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.791218+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.351157+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.492478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.505138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:46:49.573401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:24.005 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 msgr2=0x7f380c04fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.005 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 0x7f380c04fa90 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f381c001f50 tx=0x7f381c002480).stop 2020-04-02T23:47:24.005 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 msgr2=0x7f382c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.005 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f382c0a9c10 tx=0x7f3820007a40).stop 2020-04-02T23:47:24.005 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 shutdown_connections 2020-04-02T23:47:24.006 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f380c04d5d0 0x7f380c04fa90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.006 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f382c140bb0 0x7f382c0a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.006 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 --2- 172.21.15.82:0/426464772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f382c0a6b90 0x7f382c138230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 >> 172.21.15.82:0/426464772 conn(0x7f382c09de60 msgr2=0x7f382c068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 shutdown_connections 2020-04-02T23:47:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.002+0000 7f38315e3700 1 -- 172.21.15.82:0/426464772 wait complete. 2020-04-02T23:47:24.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:42.430184+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:55.708328+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:46:58.921423+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:01.321018+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:47:24.016 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:24.029 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:47:24.176 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.174+0000 7f4e863fb700 1 Processor -- start 2020-04-02T23:47:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.174+0000 7f4e863fb700 1 -- start start 2020-04-02T23:47:24.753 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e863fb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800a8410 0x7f4e8009f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e863fb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e800a6e70 0x7f4e800a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e863fb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e80135ff0 0x7f4e80136440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e863fb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800a3960 con 0x7f4e80135ff0 2020-04-02T23:47:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e863fb700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800a73f0 con 0x7f4e800a6e70 2020-04-02T23:47:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e863fb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800a6a40 con 0x7f4e800a8410 2020-04-02T23:47:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e800a6e70 0x7f4e800a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e800a6e70 0x7f4e800a3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54874/0 (socket says 172.21.15.82:54874) 2020-04-02T23:47:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 -- 172.21.15.82:0/942691630 learned_addr learned my addr 172.21.15.82:0/942691630 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:24.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e84998700 1 --2- 172.21.15.82:0/942691630 >> v2:172.21.15.50:3300/0 conn(0x7f4e80135ff0 0x7f4e80136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7ffff700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800a8410 0x7f4e8009f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 -- 172.21.15.82:0/942691630 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800a8410 msgr2=0x7f4e8009f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:24.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800a8410 0x7f4e8009f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 -- 172.21.15.82:0/942691630 >> v2:172.21.15.50:3300/0 conn(0x7f4e80135ff0 msgr2=0x7f4e80136440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:24.755 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> v2:172.21.15.50:3300/0 conn(0x7f4e80135ff0 0x7f4e80136440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 -- 172.21.15.82:0/942691630 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800a7690 con 0x7f4e800a6e70 2020-04-02T23:47:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> v2:172.21.15.82:3300/0 conn(0x7f4e800a6e70 0x7f4e800a3dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e74002f30 tx=0x7f4e74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> v2:172.21.15.82:3300/0 conn(0x7f4e800a6e70 0x7f4e800a3dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e74002f30 tx=0x7f4e74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e800a6e70 0x7f4e800a3dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f4e74002f30 tx=0x7f4e74007a40).ready entity=mon.1 client_cookie=7f9ab02a8adeb891 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e800a6e70 0x7f4e800a3dc0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f4e74002f30 tx=0x7f4e74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e800a6e70 0x7f4e800a3dc0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f4e74002f30 tx=0x7f4e74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7effd700 1 -- 172.21.15.82:0/942691630 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e74008e10 con 0x7f4e800a6e70 2020-04-02T23:47:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.175+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e800a6e70 0x7f4e800a3dc0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f4e74002f30 tx=0x7f4e74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e7effd700 1 -- 172.21.15.82:0/942691630 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74011750 con 0x7f4e800a6e70 2020-04-02T23:47:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e7effd700 1 -- 172.21.15.82:0/942691630 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e74011b30 con 0x7f4e800a6e70 2020-04-02T23:47:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 -- 172.21.15.82:0/942691630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e800a6e70 msgr2=0x7f4e800a3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e800a6e70 0x7f4e800a3dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f4e74002f30 tx=0x7f4e74007a40).stop 2020-04-02T23:47:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 -- 172.21.15.82:0/942691630 shutdown_connections 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 --2- 172.21.15.82:0/942691630 >> v2:172.21.15.50:3300/0 conn(0x7f4e80135ff0 0x7f4e80136440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e800a8410 0x7f4e8009f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 --2- 172.21.15.82:0/942691630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e800a6e70 0x7f4e800a3dc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 -- 172.21.15.82:0/942691630 >> 172.21.15.82:0/942691630 conn(0x7f4e800ab970 msgr2=0x7f4e800a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 -- 172.21.15.82:0/942691630 shutdown_connections 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.176+0000 7f4e863fb700 1 -- 172.21.15.82:0/942691630 wait complete. 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.177+0000 7f4e863fb700 1 Processor -- start 2020-04-02T23:47:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.177+0000 7f4e863fb700 1 -- start start 2020-04-02T23:47:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e863fb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e800a6e70 0x7f4e801327f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e863fb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 0x7f4e80132eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e863fb700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e80133310 con 0x7f4e800a8410 2020-04-02T23:47:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e863fb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8013fd40 con 0x7f4e800a6e70 2020-04-02T23:47:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e863fb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80149d90 con 0x7f4e80135ff0 2020-04-02T23:47:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4e800a8410 0x7f4e80146610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54930/0 (socket says 172.21.15.82:54930) 2020-04-02T23:47:24.761 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7f7fe700 1 -- 172.21.15.82:0/2121570953 learned_addr learned my addr 172.21.15.82:0/2121570953 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:24.761 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7ffff700 1 --2- 172.21.15.82:0/2121570953 >> v2:172.21.15.50:3300/0 conn(0x7f4e800a6e70 0x7f4e801327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.761 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 0x7f4e80132eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.761 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007831944 0 0) 0x7f4e800a7690 con 0x7f4e800a8410 2020-04-02T23:47:24.761 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e60002fe0 con 0x7f4e800a8410 2020-04-02T23:47:24.762 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3913557195 0 0) 0x7f4e60002fe0 con 0x7f4e800a8410 2020-04-02T23:47:24.763 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e800a7690 con 0x7f4e800a8410 2020-04-02T23:47:24.763 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f4e740085c0 con 0x7f4e800a8410 2020-04-02T23:47:24.763 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 msgr2=0x7f4e80132eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 0x7f4e80132eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 >> v2:172.21.15.50:3300/0 conn(0x7f4e800a6e70 msgr2=0x7f4e801327f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 --2- 172.21.15.82:0/2121570953 >> v2:172.21.15.50:3300/0 conn(0x7f4e800a6e70 0x7f4e801327f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 >> v1:172.21.15.82:6789/0 conn(0x7f4e800a8410 legacy=0x7f4e80146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e600049b0 0x7f4e60004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 0x7f4e60003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8013fd40 con 0x7f4e600049b0 2020-04-02T23:47:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80149d90 con 0x7f4e60003d80 2020-04-02T23:47:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600047d0 con 0x7f4e80135ff0 2020-04-02T23:47:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7f7fe700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 0x7f4e60003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.178+0000 7f4e7ffff700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e600049b0 0x7f4e60004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 -- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 msgr2=0x7f4e60003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e80135ff0 0x7f4e60003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 -- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e600049b0 msgr2=0x7f4e60004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e600049b0 0x7f4e60004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8014a030 con 0x7f4e60003d80 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8014a2d0 con 0x7f4e60003d80 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8014a770 con 0x7f4e60003d80 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e78011db0 con 0x7f4e60003d80 2020-04-02T23:47:24.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e78008400 con 0x7f4e60003d80 2020-04-02T23:47:24.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e780087a0 con 0x7f4e60003d80 2020-04-02T23:47:24.767 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.179+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c003340 con 0x7f4e60003d80 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4e78008900 con 0x7f4e60003d80 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e7d7fa700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4e600555e0 0x7f4e60057aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4e78061100 con 0x7f4e60003d80 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e7ffff700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4e600555e0 0x7f4e60057aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e7ffff700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4e600555e0 0x7f4e60057aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e70002f30 tx=0x7f4e7000dc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.768 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e7ffff700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4e600555e0 0x7f4e60057aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e70002f30 tx=0x7f4e7000dc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.180+0000 7f4e7ffff700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4e600555e0 0x7f4e60057aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f4e70002f30 tx=0x7f4e7000dc70).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.183+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.183+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4e7803c840 con 0x7f4e60003d80 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.322+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4e5c002220 con 0x7f4e60003d80 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.322+0000 7f4e84998700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.322+0000 7f4e7d7fa700 1 -- 172.21.15.82:0/2121570953 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4e7803fe60 con 0x7f4e60003d80 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4e600555e0 msgr2=0x7f4e60057aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.769 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4e600555e0 0x7f4e60057aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f4e70002f30 tx=0x7f4e7000dc70).stop 2020-04-02T23:47:24.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 msgr2=0x7f4e60004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 --2- 172.21.15.82:0/2121570953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60003d80 0x7f4e60004200 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f4e780032b0 tx=0x7f4e78011150).stop 2020-04-02T23:47:24.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e84998700 1 -- 172.21.15.82:0/2121570953 reap_dead start 2020-04-02T23:47:24.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e84998700 1 -- 172.21.15.82:0/2121570953 reap_dead start 2020-04-02T23:47:24.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 shutdown_connections 2020-04-02T23:47:24.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 >> 172.21.15.82:0/2121570953 conn(0x7f4e800ab970 msgr2=0x7f4e800a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:24.770 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 shutdown_connections 2020-04-02T23:47:24.771 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.324+0000 7f4e863fb700 1 -- 172.21.15.82:0/2121570953 wait complete. 2020-04-02T23:47:24.771 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2020-04-02T23:47:24.773 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:24.788 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:47:24.790 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:24.834 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:24.889 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.946+0000 7fcdbb837700 1 Processor -- start 2020-04-02T23:47:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.946+0000 7fcdbb837700 1 -- start start 2020-04-02T23:47:24.955 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.946+0000 7fcdbb837700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 0x7fcdb40aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.955 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.946+0000 7fcdbb837700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb40aabc0 con 0x7fcdb40658e0 2020-04-02T23:47:24.955 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.946+0000 7fcdbb837700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb4133470 con 0x7fcdb4065cc0 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.946+0000 7fcdbb837700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb409f3c0 con 0x7fcdb41394a0 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcdb8dd2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcdb4065cc0 0x7fcdb4138d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54944/0 (socket says 172.21.15.82:54944) 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcdb8dd2700 1 -- 172.21.15.82:0/3714414764 learned_addr learned my addr 172.21.15.82:0/3714414764 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 0x7fcdb40aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736696497 0 0) 0x7fcdb4133470 con 0x7fcdb4065cc0 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd9c003230 con 0x7fcdb4065cc0 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119378326 0 0) 0x7fcdac001450 con 0x7fcdb40658e0 2020-04-02T23:47:24.956 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb4133470 con 0x7fcdb40658e0 2020-04-02T23:47:24.957 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 810113619 0 0) 0x7fcd9c003230 con 0x7fcdb4065cc0 2020-04-02T23:47:24.957 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 msgr2=0x7fcdb40aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:24.957 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 0x7fcdb40aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.957 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 >> v1:172.21.15.50:6789/0 conn(0x7fcdb40658e0 legacy=0x7fcdb405c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.957 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb409f660 con 0x7fcdb4065cc0 2020-04-02T23:47:24.957 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fcda40016d0 con 0x7fcdb4065cc0 2020-04-02T23:47:24.957 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 >> v1:172.21.15.82:6789/0 conn(0x7fcdb4065cc0 legacy=0x7fcdb4138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.958 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c0038b0 0x7fcd9c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.958 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 0x7fcd9c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.958 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.958 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb409f3c0 con 0x7fcd9c0038b0 2020-04-02T23:47:24.958 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c005210 con 0x7fcd9c004930 2020-04-02T23:47:24.958 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c00b720 con 0x7fcdb41394a0 2020-04-02T23:47:24.958 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcdb95d3700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c0038b0 0x7fcd9c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcdb8dd2700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 0x7fcd9c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.947+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 -- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 msgr2=0x7fcd9c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 0x7fcd9c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 -- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c0038b0 msgr2=0x7fcd9c003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c0038b0 0x7fcd9c003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 -- 172.21.15.82:0/3714414764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c003230 con 0x7fcd9c004930 2020-04-02T23:47:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb8dd2700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb41394a0 0x7fcd9c0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:24.960 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb95d3700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c0038b0 0x7fcd9c003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:24.960 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcdb0002f30 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.960 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcdb0002f30 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.960 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fcdb0002f30 tx=0x7fcdb0010020).ready entity=mon.1 client_cookie=284e3a5b2e7a1bf2 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.960 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fcdb0002f30 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fcdb0002f30 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fcdb0002f30 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb0008d30 con 0x7fcd9c004930 2020-04-02T23:47:24.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0008e90 con 0x7fcd9c004930 2020-04-02T23:47:24.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcda3fff700 1 -- 172.21.15.82:0/3714414764 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb0010a90 con 0x7fcd9c004930 2020-04-02T23:47:24.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdbb837700 1 -- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 msgr2=0x7fcd9c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdbb837700 1 --2- 172.21.15.82:0/3714414764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c004930 0x7fcd9c004db0 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fcdb0002f30 tx=0x7fcdb0010020).stop 2020-04-02T23:47:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.948+0000 7fcdb9dd4700 1 -- 172.21.15.82:0/3714414764 reap_dead start 2020-04-02T23:47:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.949+0000 7fcdbb837700 1 -- 172.21.15.82:0/3714414764 shutdown_connections 2020-04-02T23:47:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.949+0000 7fcdbb837700 1 -- 172.21.15.82:0/3714414764 >> 172.21.15.82:0/3714414764 conn(0x7fcdb40af2e0 msgr2=0x7fcdb40af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.949+0000 7fcdbb837700 1 -- 172.21.15.82:0/3714414764 shutdown_connections 2020-04-02T23:47:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.949+0000 7fcdbb837700 1 -- 172.21.15.82:0/3714414764 wait complete. 2020-04-02T23:47:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdbb837700 1 Processor -- start 2020-04-02T23:47:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdbb837700 1 -- start start 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdbb837700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb413db40 0x7fcdb4149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdbb837700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcdb413ae30 0x7fcdb413b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdbb837700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb414a060 con 0x7fcdb40a02e0 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdbb837700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb413c9f0 con 0x7fcdb413ae30 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdbb837700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40a06c0 con 0x7fcdb413db40 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdb95d3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcdb40a02e0 0x7fcdb413c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54954/0 (socket says 172.21.15.82:54954) 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdb95d3700 1 -- 172.21.15.82:0/539860940 learned_addr learned my addr 172.21.15.82:0/539860940 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> v2:172.21.15.82:3300/0 conn(0x7fcdb413ae30 0x7fcdb413b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.950+0000 7fcdb8dd2700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb413db40 0x7fcdb4149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 -- 172.21.15.82:0/539860940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb413db40 msgr2=0x7fcdb4149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb413db40 0x7fcdb4149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 -- 172.21.15.82:0/539860940 >> v1:172.21.15.82:6789/0 conn(0x7fcdb40a02e0 legacy=0x7fcdb413c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 -- 172.21.15.82:0/539860940 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb413cbf0 con 0x7fcdb413ae30 2020-04-02T23:47:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547127850 0 0) 0x7fcdb414a060 con 0x7fcdb40a02e0 2020-04-02T23:47:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> v2:172.21.15.82:3300/0 conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> v2:172.21.15.82:3300/0 conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb0010d20 con 0x7fcdb413ae30 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0010e80 con 0x7fcdb413ae30 2020-04-02T23:47:24.965 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb00058b0 con 0x7fcdb413ae30 2020-04-02T23:47:24.966 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb413d400 con 0x7fcdb413ae30 2020-04-02T23:47:24.966 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.951+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb413b700 con 0x7fcdb413ae30 2020-04-02T23:47:24.966 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.952+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.966 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.952+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb413d860 con 0x7fcdb413ae30 2020-04-02T23:47:24.966 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.952+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fcdb0005a10 con 0x7fcdb413ae30 2020-04-02T23:47:24.966 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.952+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.966 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.953+0000 7fcda27fc700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 0x7fcd9404fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.953+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcdb0060bf0 con 0x7fcdb413ae30 2020-04-02T23:47:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.953+0000 7fcdb95d3700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 0x7fcd9404fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.953+0000 7fcdb95d3700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 0x7fcd9404fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcdac001e00 tx=0x7fcdac004220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.953+0000 7fcdb95d3700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 0x7fcd9404fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcdac001e00 tx=0x7fcdac004220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.953+0000 7fcdb95d3700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 0x7fcd9404fa20 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fcdac001e00 tx=0x7fcdac004220).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.956+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:24.956+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fcdb003c330 con 0x7fcdb413ae30 2020-04-02T23:47:25.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.096+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcdb4056c50 con 0x7fcdb413ae30 2020-04-02T23:47:25.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.096+0000 7fcdb9dd4700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.096+0000 7fcda27fc700 1 -- 172.21.15.82:0/539860940 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcdb003f950 con 0x7fcdb413ae30 2020-04-02T23:47:25.099 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:25.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 msgr2=0x7fcd9404fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 0x7fcd9404fa20 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fcdac001e00 tx=0x7fcdac004220).stop 2020-04-02T23:47:25.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 msgr2=0x7fcdb413b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fcdb405eca0 tx=0x7fcdb0010020).stop 2020-04-02T23:47:25.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 shutdown_connections 2020-04-02T23:47:25.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb413ae30 0x7fcdb413b2a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcd9404d560 0x7fcd9404fa20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 --2- 172.21.15.82:0/539860940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdb413db40 0x7fcdb4149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.097+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 >> 172.21.15.82:0/539860940 conn(0x7fcdb40af2e0 msgr2=0x7fcdb4068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:25.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.098+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 shutdown_connections 2020-04-02T23:47:25.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.098+0000 7fcdbb837700 1 -- 172.21.15.82:0/539860940 wait complete. 2020-04-02T23:47:25.109 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:25.123 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:47:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.269+0000 7f1fe3f05700 1 Processor -- start 2020-04-02T23:47:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.269+0000 7f1fe3f05700 1 -- start start 2020-04-02T23:47:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.269+0000 7f1fe3f05700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0a8410 0x7f1fdc09f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.269+0000 7f1fe3f05700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc136440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe3f05700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0a3960 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe3f05700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0a4890 con 0x7f1fdc135ff0 2020-04-02T23:47:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe3f05700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0a73f0 con 0x7f1fdc0a8410 2020-04-02T23:47:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc136440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54914/0 (socket says 172.21.15.82:54914) 2020-04-02T23:47:25.275 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 -- 172.21.15.82:0/41964490 learned_addr learned my addr 172.21.15.82:0/41964490 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:25.275 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0a8410 0x7f1fdc09f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.275 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 -- 172.21.15.82:0/41964490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0a8410 msgr2=0x7f1fdc09f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:25.276 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0a8410 0x7f1fdc09f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.276 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 -- 172.21.15.82:0/41964490 >> v1:172.21.15.50:6789/0 conn(0x7f1fdc0a6e70 legacy=0x7f1fdc0a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.276 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 -- 172.21.15.82:0/41964490 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0a6a40 con 0x7f1fdc135ff0 2020-04-02T23:47:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/41964490 >> v2:172.21.15.82:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc136440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1fd40032b0 tx=0x7f1fd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/41964490 >> v2:172.21.15.82:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc136440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1fd40032b0 tx=0x7f1fd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc135ff0 0x7f1fdc136440 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f1fd40032b0 tx=0x7f1fd4007dc0).ready entity=mon.1 client_cookie=cbeb03b6b4d8d7e9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc135ff0 0x7f1fdc136440 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f1fd40032b0 tx=0x7f1fd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe0c9f700 1 -- 172.21.15.82:0/41964490 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd40110c0 con 0x7f1fdc135ff0 2020-04-02T23:47:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc135ff0 0x7f1fdc136440 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f1fd40032b0 tx=0x7f1fd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc135ff0 0x7f1fdc136440 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f1fd40032b0 tx=0x7f1fd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe0c9f700 1 -- 172.21.15.82:0/41964490 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4011220 con 0x7f1fdc135ff0 2020-04-02T23:47:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe0c9f700 1 -- 172.21.15.82:0/41964490 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd4011640 con 0x7f1fdc135ff0 2020-04-02T23:47:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe3f05700 1 -- 172.21.15.82:0/41964490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc135ff0 msgr2=0x7f1fdc136440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.270+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc135ff0 0x7f1fdc136440 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f1fd40032b0 tx=0x7f1fd4007dc0).stop 2020-04-02T23:47:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.271+0000 7f1fe3f05700 1 -- 172.21.15.82:0/41964490 shutdown_connections 2020-04-02T23:47:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.271+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0a8410 0x7f1fdc09f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.271+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/41964490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc135ff0 0x7f1fdc136440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.271+0000 7f1fe3f05700 1 -- 172.21.15.82:0/41964490 >> 172.21.15.82:0/41964490 conn(0x7f1fdc0ab970 msgr2=0x7f1fdc0a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.271+0000 7f1fe3f05700 1 -- 172.21.15.82:0/41964490 shutdown_connections 2020-04-02T23:47:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.271+0000 7f1fe3f05700 1 -- 172.21.15.82:0/41964490 wait complete. 2020-04-02T23:47:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe3f05700 1 Processor -- start 2020-04-02T23:47:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe3f05700 1 -- start start 2020-04-02T23:47:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe3f05700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe3f05700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe3f05700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0a5880 con 0x7f1fdc0a8410 2020-04-02T23:47:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe3f05700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0a5b20 con 0x7f1fdc135ff0 2020-04-02T23:47:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe3f05700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0a5dc0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe1ca1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe1ca1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54918/0 (socket says 172.21.15.82:54918) 2020-04-02T23:47:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe1ca1700 1 -- 172.21.15.82:0/974030553 learned_addr learned my addr 172.21.15.82:0/974030553 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.272+0000 7f1fe24a2700 1 --2- 172.21.15.82:0/974030553 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 -- 172.21.15.82:0/974030553 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc135ff0 msgr2=0x7f1fdc147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 -- 172.21.15.82:0/974030553 >> v1:172.21.15.50:6789/0 conn(0x7f1fdc0a8410 legacy=0x7f1fdc147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 -- 172.21.15.82:0/974030553 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0a6060 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> v2:172.21.15.82:3300/0 conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> v2:172.21.15.82:3300/0 conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fcaffd700 1 -- 172.21.15.82:0/974030553 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fcc012aa0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fcaffd700 1 -- 172.21.15.82:0/974030553 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc012c00 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc1336e0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fcaffd700 1 -- 172.21.15.82:0/974030553 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fcc0091a0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.273+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc0689b0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.274+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.274+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc0a61f0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.274+0000 7f1fcaffd700 1 -- 172.21.15.82:0/974030553 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1fcc007170 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.274+0000 7f1fcaffd700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 0x7f1fbc04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.275+0000 7f1fe14a0700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 0x7f1fbc04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.275+0000 7f1fe14a0700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 0x7f1fbc04fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1fdc1336a0 tx=0x7f1fd80025d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.275+0000 7f1fe14a0700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 0x7f1fbc04fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1fdc1336a0 tx=0x7f1fd80025d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.275+0000 7f1fe14a0700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 0x7f1fbc04fa50 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f1fdc1336a0 tx=0x7f1fd80025d0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.275+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.275+0000 7f1fcaffd700 1 -- 172.21.15.82:0/974030553 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1fcc040900 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.278+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.278+0000 7f1fcaffd700 1 -- 172.21.15.82:0/974030553 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1fcc03cca0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.415+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fdc056c50 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.415+0000 7f1fe1ca1700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.415+0000 7f1fcaffd700 1 -- 172.21.15.82:0/974030553 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1fcc0402c0 con 0x7f1fdc0a6e70 2020-04-02T23:47:25.418 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.416+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 msgr2=0x7f1fbc04fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 0x7f1fbc04fa50 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f1fdc1336a0 tx=0x7f1fd80025d0).stop 2020-04-02T23:47:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 msgr2=0x7f1fdc0a6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f1fcc002f30 tx=0x7f1fcc010c30).stop 2020-04-02T23:47:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 shutdown_connections 2020-04-02T23:47:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f1fbc04d590 0x7f1fbc04fa50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/974030553 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc135ff0 0x7f1fdc147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 --2- 172.21.15.82:0/974030553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0a6e70 0x7f1fdc0a6500 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 >> 172.21.15.82:0/974030553 conn(0x7f1fdc0ab970 msgr2=0x7f1fdc0a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 shutdown_connections 2020-04-02T23:47:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.417+0000 7f1fe3f05700 1 -- 172.21.15.82:0/974030553 wait complete. 2020-04-02T23:47:25.429 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:25.441 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:47:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.587+0000 7fe64b416700 1 Processor -- start 2020-04-02T23:47:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.587+0000 7fe64b416700 1 -- start start 2020-04-02T23:47:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe64b416700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 0x7fe644067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe64b416700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440a2460 con 0x7fe6440a3320 2020-04-02T23:47:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe64b416700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440a3b50 con 0x7fe6440a66a0 2020-04-02T23:47:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe64b416700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440a4270 con 0x7fe6440a4fc0 2020-04-02T23:47:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe6489b1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe6440a66a0 0x7fe644066b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54976/0 (socket says 172.21.15.82:54976) 2020-04-02T23:47:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe6489b1700 1 -- 172.21.15.82:0/1726673441 learned_addr learned my addr 172.21.15.82:0/1726673441 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe6499b3700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 0x7fe644067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631619843 0 0) 0x7fe6440a3b50 con 0x7fe6440a66a0 2020-04-02T23:47:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe62c003230 con 0x7fe6440a66a0 2020-04-02T23:47:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509667184 0 0) 0x7fe6440a2460 con 0x7fe6440a3320 2020-04-02T23:47:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6440a3b50 con 0x7fe6440a3320 2020-04-02T23:47:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 469541342 0 0) 0x7fe62c003230 con 0x7fe6440a66a0 2020-04-02T23:47:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 msgr2=0x7fe644067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 0x7fe644067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 >> v1:172.21.15.50:6789/0 conn(0x7fe6440a3320 legacy=0x7fe6440a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440a5850 con 0x7fe6440a66a0 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fe6400016d0 con 0x7fe6440a66a0 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.588+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 >> v1:172.21.15.82:6789/0 conn(0x7fe6440a66a0 legacy=0x7fe644066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 0x7fe62c0038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62c004930 0x7fe62c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440a4270 con 0x7fe62c004930 2020-04-02T23:47:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c005210 con 0x7fe62c003d10 2020-04-02T23:47:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c00b720 con 0x7fe6440a4fc0 2020-04-02T23:47:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6499b3700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62c004930 0x7fe62c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6491b2700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 0x7fe62c0038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 -- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 msgr2=0x7fe62c0038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 0x7fe62c0038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 -- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62c004930 msgr2=0x7fe62c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62c004930 0x7fe62c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 -- 172.21.15.82:0/1726673441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c003230 con 0x7fe62c003d10 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6499b3700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62c004930 0x7fe62c004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6491b2700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6440a4fc0 0x7fe62c0038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6400014a0 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6400014a0 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fe6400014a0 tx=0x7fe64000c330).ready entity=mon.1 client_cookie=7dce0178c84f2144 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fe6400014a0 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fe6400014a0 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe640010160 con 0x7fe62c003d10 2020-04-02T23:47:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6489b1700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fe6400014a0 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6400102c0 con 0x7fe62c003d10 2020-04-02T23:47:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe633fff700 1 -- 172.21.15.82:0/1726673441 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe640010620 con 0x7fe62c003d10 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe64b416700 1 -- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 msgr2=0x7fe62c0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe64b416700 1 --2- 172.21.15.82:0/1726673441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe62c003d10 0x7fe62c0044d0 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fe6400014a0 tx=0x7fe64000c330).stop 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.589+0000 7fe6499b3700 1 -- 172.21.15.82:0/1726673441 reap_dead start 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.590+0000 7fe64b416700 1 -- 172.21.15.82:0/1726673441 shutdown_connections 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.590+0000 7fe64b416700 1 -- 172.21.15.82:0/1726673441 >> 172.21.15.82:0/1726673441 conn(0x7fe6440ab970 msgr2=0x7fe6440a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.590+0000 7fe64b416700 1 -- 172.21.15.82:0/1726673441 shutdown_connections 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.590+0000 7fe64b416700 1 -- 172.21.15.82:0/1726673441 wait complete. 2020-04-02T23:47:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.590+0000 7fe64b416700 1 Processor -- start 2020-04-02T23:47:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe64b416700 1 -- start start 2020-04-02T23:47:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe64b416700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe644090ea0 0x7fe644093c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe64b416700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe644067290 con 0x7fe644065fd0 2020-04-02T23:47:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe64b416700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe644139610 con 0x7fe644138a70 2020-04-02T23:47:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe64b416700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe644092a00 con 0x7fe644090ea0 2020-04-02T23:47:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe6499b3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe644138a70 0x7fe644138f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54990/0 (socket says 172.21.15.82:54990) 2020-04-02T23:47:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe6499b3700 1 -- 172.21.15.82:0/287627916 learned_addr learned my addr 172.21.15.82:0/287627916 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615749714 0 0) 0x7fe644139610 con 0x7fe644138a70 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe624002fe0 con 0x7fe644138a70 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.591+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> v2:172.21.15.50:3300/0 conn(0x7fe644090ea0 0x7fe644093c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1327701086 0 0) 0x7fe624002fe0 con 0x7fe644138a70 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe644139610 con 0x7fe644138a70 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fe63c001810 con 0x7fe644138a70 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 >> v2:172.21.15.50:3300/0 conn(0x7fe644090ea0 msgr2=0x7fe644093c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 --2- 172.21.15.82:0/287627916 >> v2:172.21.15.50:3300/0 conn(0x7fe644090ea0 0x7fe644093c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 >> v1:172.21.15.82:6789/0 conn(0x7fe644138a70 legacy=0x7fe644138f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 >> v1:172.21.15.50:6789/0 conn(0x7fe644065fd0 legacy=0x7fe644090790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6240049b0 0x7fe624004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6240041c0 0x7fe62400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624004640 con 0x7fe6240049b0 2020-04-02T23:47:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240047b0 con 0x7fe624003920 2020-04-02T23:47:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62400bbb0 con 0x7fe6240041c0 2020-04-02T23:47:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> v2:172.21.15.50:3300/0 conn(0x7fe644090ea0 0x7fe644093c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6491b2700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6240049b0 0x7fe624004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6499b3700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6240041c0 0x7fe62400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 -- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6240041c0 msgr2=0x7fe62400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6240041c0 0x7fe62400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 -- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6240049b0 msgr2=0x7fe624004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6240049b0 0x7fe624004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6499b3700 1 -- 172.21.15.82:0/287627916 reap_dead start 2020-04-02T23:47:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64413ee30 con 0x7fe624003920 2020-04-02T23:47:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6440918b0 con 0x7fe624003920 2020-04-02T23:47:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe644091bb0 con 0x7fe624003920 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe640005a40 con 0x7fe624003920 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6400150a0 con 0x7fe624003920 2020-04-02T23:47:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.592+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe640005d90 con 0x7fe624003920 2020-04-02T23:47:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.593+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.593+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644056c50 con 0x7fe624003920 2020-04-02T23:47:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.593+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe64000d840 con 0x7fe624003920 2020-04-02T23:47:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.593+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.594+0000 7fe6327fc700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 0x7fe6240532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.594+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe6400609f0 con 0x7fe624003920 2020-04-02T23:47:25.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.594+0000 7fe6491b2700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 0x7fe6240532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.594+0000 7fe6491b2700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 0x7fe6240532e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6440a23b0 tx=0x7fe63400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.594+0000 7fe6491b2700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 0x7fe6240532e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6440a23b0 tx=0x7fe63400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.594+0000 7fe6491b2700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 0x7fe6240532e0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe6440a23b0 tx=0x7fe63400c820).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.612 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.597+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.612 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.597+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe64003c2a0 con 0x7fe624003920 2020-04-02T23:47:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.733+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6440a7540 con 0x7fe624003920 2020-04-02T23:47:25.736 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.734+0000 7fe6489b1700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.736 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.734+0000 7fe6327fc700 1 -- 172.21.15.82:0/287627916 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe64003f8c0 con 0x7fe624003920 2020-04-02T23:47:25.736 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2020-04-02T23:47:25.737 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 msgr2=0x7fe6240532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.737 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 0x7fe6240532e0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe6440a23b0 tx=0x7fe63400c820).stop 2020-04-02T23:47:25.737 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 msgr2=0x7fe624003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.737 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7fe624005650 tx=0x7fe64000c330).stop 2020-04-02T23:47:25.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 shutdown_connections 2020-04-02T23:47:25.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe624050e20 0x7fe6240532e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 --2- 172.21.15.82:0/287627916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe624003920 0x7fe624003d60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 >> 172.21.15.82:0/287627916 conn(0x7fe6440ab970 msgr2=0x7fe64405b010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:25.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 shutdown_connections 2020-04-02T23:47:25.738 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.735+0000 7fe64b416700 1 -- 172.21.15.82:0/287627916 wait complete. 2020-04-02T23:47:25.747 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-02T23:47:25.747 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:25.760 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:47:25.905 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.903+0000 7f2760014700 1 Processor -- start 2020-04-02T23:47:25.905 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.903+0000 7f2760014700 1 -- start start 2020-04-02T23:47:25.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f2758060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f275805f020 0x7f275805f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27580a79f0 0x7f27580a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:25.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580a95a0 con 0x7f27580a79f0 2020-04-02T23:47:25.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580628e0 con 0x7f275805c3a0 2020-04-02T23:47:25.911 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2758062b10 con 0x7f275805f020 2020-04-02T23:47:25.912 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f2758060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.912 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f2758060cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54950/0 (socket says 172.21.15.82:54950) 2020-04-02T23:47:25.912 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 -- 172.21.15.82:0/2557435106 learned_addr learned my addr 172.21.15.82:0/2557435106 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:47:25.912 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275d5af700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f275805f020 0x7f275805f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.912 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275e5b1700 1 --2- 172.21.15.82:0/2557435106 >> v2:172.21.15.50:3300/0 conn(0x7f27580a79f0 0x7f27580a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.912 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 -- 172.21.15.82:0/2557435106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f275805f020 msgr2=0x7f275805f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:25.912 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f275805f020 0x7f275805f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 -- 172.21.15.82:0/2557435106 >> v2:172.21.15.50:3300/0 conn(0x7f27580a79f0 msgr2=0x7f27580a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> v2:172.21.15.50:3300/0 conn(0x7f27580a79f0 0x7f27580a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 -- 172.21.15.82:0/2557435106 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275805f900 con 0x7f275805c3a0 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f2758060cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f2758060cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f2758060cb0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).ready entity=mon.1 client_cookie=ee3285b2b508c390 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f2758060cb0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.913 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f2758060cb0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275cdae700 1 -- 172.21.15.82:0/2557435106 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f275000a160 con 0x7f275805c3a0 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f2758060cb0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275cdae700 1 -- 172.21.15.82:0/2557435106 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275000a2c0 con 0x7f275805c3a0 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f275cdae700 1 -- 172.21.15.82:0/2557435106 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f275000a6a0 con 0x7f275805c3a0 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 -- 172.21.15.82:0/2557435106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 msgr2=0x7f2758060cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.904+0000 7f2760014700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f2758060cb0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).stop 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.905+0000 7f2760014700 1 -- 172.21.15.82:0/2557435106 shutdown_connections 2020-04-02T23:47:25.914 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.905+0000 7f2760014700 1 --2- 172.21.15.82:0/2557435106 >> v2:172.21.15.50:3300/0 conn(0x7f27580a79f0 0x7f27580a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.915 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.905+0000 7f2760014700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f2758060cb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:25.915 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.905+0000 7f2760014700 1 --2- 172.21.15.82:0/2557435106 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f275805f020 0x7f275805f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:25.915 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.905+0000 7f2760014700 1 -- 172.21.15.82:0/2557435106 >> 172.21.15.82:0/2557435106 conn(0x7f27580aa630 msgr2=0x7f27580ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:25.915 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.905+0000 7f2760014700 1 -- 172.21.15.82:0/2557435106 shutdown_connections 2020-04-02T23:47:25.915 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.905+0000 7f2760014700 1 -- 172.21.15.82:0/2557435106 wait complete. 2020-04-02T23:47:25.915 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f2760014700 1 Processor -- start 2020-04-02T23:47:25.915 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f2760014700 1 -- start start 2020-04-02T23:47:25.916 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f2760014700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f27580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.916 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f2760014700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2758064e70 con 0x7f275805f020 2020-04-02T23:47:25.916 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f2760014700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580a2ed0 con 0x7f27580a79f0 2020-04-02T23:47:25.916 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f2760014700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580a3170 con 0x7f275805c3a0 2020-04-02T23:47:25.916 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f275ddb0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f27580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.916 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f275e5b1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f27580a79f0 0x7f27580a6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55010/0 (socket says 172.21.15.82:55010) 2020-04-02T23:47:25.916 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f275ddb0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f27580a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54958/0 (socket says 172.21.15.82:54958) 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.906+0000 7f275e5b1700 1 -- 172.21.15.82:0/2089032793 learned_addr learned my addr 172.21.15.82:0/2089032793 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 -- 172.21.15.82:0/2089032793 >> v1:172.21.15.82:6789/0 conn(0x7f27580a79f0 legacy=0x7f27580a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 -- 172.21.15.82:0/2089032793 >> v1:172.21.15.50:6789/0 conn(0x7f275805f020 legacy=0x7f275813cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797529731 0 0) 0x7f27580a2ed0 con 0x7f27580a79f0 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 -- 172.21.15.82:0/2089032793 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580a3ce0 con 0x7f275805c3a0 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> v2:172.21.15.82:3300/0 conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.917 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2750005c30 con 0x7f275805c3a0 2020-04-02T23:47:25.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750005d90 con 0x7f275805c3a0 2020-04-02T23:47:25.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2750007340 con 0x7f275805c3a0 2020-04-02T23:47:25.918 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580a2bc0 con 0x7f275805c3a0 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275813d7b0 con 0x7f275805c3a0 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.907+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f27500074a0 con 0x7f275805c3a0 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2758056c50 con 0x7f275805c3a0 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f274affd700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 0x7f273804f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2750061a10 con 0x7f275805c3a0 2020-04-02T23:47:25.919 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f275d5af700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 0x7f273804f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:25.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f275d5af700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 0x7f273804f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2758065470 tx=0x7f274c008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f275d5af700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 0x7f273804f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2758065470 tx=0x7f274c008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.908+0000 7f275d5af700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 0x7f273804f8a0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f2758065470 tx=0x7f274c008d00).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:25.920 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.911+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:25.921 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:25.911+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f275003d230 con 0x7f275805c3a0 2020-04-02T23:47:26.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.092+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27580aaa40 con 0x7f275805c3a0 2020-04-02T23:47:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.092+0000 7f275ddb0700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.092+0000 7f274affd700 1 -- 172.21.15.82:0/2089032793 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f2750040850 con 0x7f275805c3a0 2020-04-02T23:47:26.095 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:47:26.095 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:47:07.704695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:47:26.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 msgr2=0x7f273804f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:26.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 0x7f273804f8a0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f2758065470 tx=0x7f274c008d00).stop 2020-04-02T23:47:26.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 msgr2=0x7f27580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:26.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f27500032b0 tx=0x7f2750007dc0).stop 2020-04-02T23:47:26.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 shutdown_connections 2020-04-02T23:47:26.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f273804d3e0 0x7f273804f8a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:26.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 --2- 172.21.15.82:0/2089032793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275805c3a0 0x7f27580a6070 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:26.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 >> 172.21.15.82:0/2089032793 conn(0x7f27580aa630 msgr2=0x7f27580abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:26.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 shutdown_connections 2020-04-02T23:47:26.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:47:26.094+0000 7f2760014700 1 -- 172.21.15.82:0/2089032793 wait complete. 2020-04-02T23:47:26.099 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2020-04-02T23:47:26.308 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4390}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4390': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4390, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1148797459, u'type': u'v2', u'addr': u'172.21.15.82:6834'}, {u'nonce': 1148797459, u'type': u'v1', u'addr': u'172.21.15.82:6835'}]}, u'addr': u'172.21.15.82:6835/1148797459'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:47:03.694261+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:47:07.704695+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:47:26.308 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:47:26.308 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:26.323 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-02T23:47:26.480 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2020-04-02T23:47:26.480 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "9ad11b85-09ab-48b2-ad7c-5536462abc65", 2020-04-02T23:47:26.481 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2020-04-02T23:47:26.481 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4390, 2020-04-02T23:47:26.481 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2020-04-02T23:47:26.481 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2020-04-02T23:47:26.481 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 19.773758560000001, 2020-04-02T23:47:26.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 6, 2020-04-02T23:47:26.482 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 26, 2020-04-02T23:47:26.482 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 26, 2020-04-02T23:47:26.482 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 19.884348185 2020-04-02T23:47:26.482 INFO:teuthology.orchestra.run.smithi082.stdout:} 2020-04-02T23:47:26.489 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "9ad11b85-09ab-48b2-ad7c-5536462abc65", "whoami": 0, "id": 4390, "want_state": "up:active", "state": "up:active", "rank_uptime": 19.773758560000001, "mdsmap_epoch": 6, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "uptime": 19.884348185 } 2020-04-02T23:47:26.489 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-02T23:47:26.489 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-02T23:47:26.489 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi082.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-02T23:47:26.490 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:26.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:26.503 INFO:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:47:26.562 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:26.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:26.611 INFO:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:47:26.678 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:47:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:47:26.691 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:26.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:26.732 INFO:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2020-04-02T23:47:26.788 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:47:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:47:26.792 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-02T23:47:26.792 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:26.841 INFO:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:47:26.885 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:26.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:26.899 INFO:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:47:26.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2020-04-02T23:47:26.957+0000 7fc5b27831c0 -1 init, newargv = 0x55c25cec8230 newargc=7 2020-04-02T23:47:26.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[29923]: starting ceph client 2020-04-02T23:47:26.967 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:47:26.978 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:47:26.978 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:26.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[29923]: starting fuse 2020-04-02T23:47:27.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:27.009 INFO:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2020-04-02T23:47:28.168 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:28.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:28.184 INFO:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:47:28.261 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:28.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:28.308 INFO:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2020-04-02T23:47:28.366 INFO:teuthology.orchestra.run.smithi082.stdout:45 2020-04-02T23:47:28.367 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2020-04-02T23:47:28.367 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:28.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:28.417 INFO:teuthology.orchestra.run.smithi082:> sudo python3 -c ' 2020-04-02T23:47:28.417 INFO:teuthology.orchestra.run.smithi082:> import glob 2020-04-02T23:47:28.417 INFO:teuthology.orchestra.run.smithi082:> import re 2020-04-02T23:47:28.417 INFO:teuthology.orchestra.run.smithi082:> import os 2020-04-02T23:47:28.418 INFO:teuthology.orchestra.run.smithi082:> import subprocess 2020-04-02T23:47:28.418 INFO:teuthology.orchestra.run.smithi082:> 2020-04-02T23:47:28.418 INFO:teuthology.orchestra.run.smithi082:> def find_socket(client_name): 2020-04-02T23:47:28.418 INFO:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-02T23:47:28.418 INFO:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2020-04-02T23:47:28.418 INFO:teuthology.orchestra.run.smithi082:> 2020-04-02T23:47:28.418 INFO:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2020-04-02T23:47:28.419 INFO:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2020-04-02T23:47:28.419 INFO:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2020-04-02T23:47:28.425 INFO:teuthology.orchestra.run.smithi082:> return files[0] 2020-04-02T23:47:28.425 INFO:teuthology.orchestra.run.smithi082:> 2020-04-02T23:47:28.425 INFO:teuthology.orchestra.run.smithi082:> for f in files: 2020-04-02T23:47:28.425 INFO:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-02T23:47:28.425 INFO:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-02T23:47:28.426 INFO:teuthology.orchestra.run.smithi082:> return f 2020-04-02T23:47:28.426 INFO:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-02T23:47:28.426 INFO:teuthology.orchestra.run.smithi082:> 2020-04-02T23:47:28.426 INFO:teuthology.orchestra.run.smithi082:> print(find_socket("client.0")) 2020-04-02T23:47:28.426 INFO:teuthology.orchestra.run.smithi082:> ' 2020-04-02T23:47:28.525 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.29923.asok 2020-04-02T23:47:28.525 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.29923.asok 2020-04-02T23:47:28.526 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:28.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:28.539 INFO:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.29923.asok status 2020-04-02T23:47:28.697 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2020-04-02T23:47:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2020-04-02T23:47:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "cbb84f71d70460f911296715ab61ac09c6962b17", 2020-04-02T23:47:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 16.0.0-316-gcbb84f7 (cbb84f71d70460f911296715ab61ac09c6962b17) octopus (rc)", 2020-04-02T23:47:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2020-04-02T23:47:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2020-04-02T23:47:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-02T23:47:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "29923", 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4837, 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2020-04-02T23:47:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2020-04-02T23:47:28.700 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 4837 2020-04-02T23:47:28.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2020-04-02T23:47:28.700 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2020-04-02T23:47:28.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2020-04-02T23:47:28.700 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2020-04-02T23:47:28.700 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1882757207 2020-04-02T23:47:28.700 INFO:teuthology.orchestra.run.smithi082.stdout: } 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1882757207 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.4837 172.21.15.82:0/1882757207", 2020-04-02T23:47:28.701 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "172.21.15.82:0/1882757207", 2020-04-02T23:47:28.702 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2020-04-02T23:47:28.702 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 6, 2020-04-02T23:47:28.702 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 26, 2020-04-02T23:47:28.702 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2020-04-02T23:47:28.702 INFO:teuthology.orchestra.run.smithi082.stdout: "blacklisted": false 2020-04-02T23:47:28.702 INFO:teuthology.orchestra.run.smithi082.stdout:} 2020-04-02T23:47:28.703 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:28.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:28.716 INFO:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:47:28.716 INFO:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:47:28.775 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2020-04-02T23:47:28.775 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:47:28.775 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:28.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:47:28.824 INFO:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:47:28.902 INFO:teuthology.run_tasks:Running task workunit... 2020-04-02T23:47:29.093 INFO:tasks.workunit:Pulling workunits from ref cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:47:29.094 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-02T23:47:29.094 INFO:tasks.workunit:timeout=3h 2020-04-02T23:47:29.094 INFO:tasks.workunit:cleanup=True 2020-04-02T23:47:29.095 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:29.117 INFO:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-02T23:47:29.190 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 2dh/45d Inode: 1 Links: 2 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:fusefs_t:s0 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2020-04-02 23:47:06.706197000 +0000 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2020-04-02 23:47:28.891655150 +0000 2020-04-02T23:47:29.191 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2020-04-02T23:47:29.192 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-04-02T23:47:29.192 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:29.257 INFO:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-04-02T23:47:29.341 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:29.400 INFO:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:47:29.526 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-02T23:47:54.993 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:47:55.011 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:55.055 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:47:55.070 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:04.576 INFO:tasks.workunit.client.0.smithi082.stderr:Note: checking out 'cbb84f71d70460f911296715ab61ac09c6962b17'. 2020-04-02T23:48:04.576 INFO:tasks.workunit.client.0.smithi082.stderr: 2020-04-02T23:48:04.576 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-02T23:48:04.576 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by performing another checkout. 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr: 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr: 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr: git checkout -b 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr: 2020-04-02T23:48:04.577 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at cbb84f71d7 Merge branch 'fs-qa-vstart_runner.LocalRemote.sh' of https://github.com/rishabh-d-dave/ceph into wip-greg-testing-42 2020-04-02T23:48:04.581 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:04.594 INFO:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-02T23:48:04.654 INFO:tasks.workunit.client.0.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-02T23:48:04.656 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:48:04.656 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-02T23:48:05.289 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-02T23:48:05.340 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-02T23:48:05.377 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:48:05.379 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:48:05.379 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-02T23:48:05.415 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:48:05.476 DEBUG:teuthology.orchestra.remote:smithi082:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-02T23:48:05.526 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2020-04-02T23:48:05.527 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2020-04-02T23:48:05.527 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:05.540 INFO:teuthology.orchestra.run.smithi082:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cbb84f71d70460f911296715ab61ac09c6962b17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2020-04-02T23:48:05.605 INFO:tasks.workunit.client.0.smithi082.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-04-02T23:48:05.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.688+0000 7fcf62bdd700 1 Processor -- start 2020-04-02T23:48:05.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.688+0000 7fcf62bdd700 1 -- start start 2020-04-02T23:48:05.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf62bdd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf5c080520 0x7fcf5c0a7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:05.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf62bdd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0a2ff0 con 0x7fcf5c0a7960 2020-04-02T23:48:05.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf62bdd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0a5ac0 con 0x7fcf5c149620 2020-04-02T23:48:05.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf62bdd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0a23c0 con 0x7fcf5c080520 2020-04-02T23:48:05.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf6197b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcf5c149620 0x7fcf5c14ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55042/0 (socket says 172.21.15.82:55042) 2020-04-02T23:48:05.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf6197b700 1 -- 172.21.15.82:0/1525238435 learned_addr learned my addr 172.21.15.82:0/1525238435 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:48:05.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538935808 0 0) 0x7fcf5c0a5ac0 con 0x7fcf5c149620 2020-04-02T23:48:05.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> v2:172.21.15.50:3300/0 conn(0x7fcf5c080520 0x7fcf5c0a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf48003230 con 0x7fcf5c149620 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2229664213 0 0) 0x7fcf48003230 con 0x7fcf5c149620 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.689+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 >> v2:172.21.15.50:3300/0 conn(0x7fcf5c080520 msgr2=0x7fcf5c0a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 --2- 172.21.15.82:0/1525238435 >> v2:172.21.15.50:3300/0 conn(0x7fcf5c080520 0x7fcf5c0a7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 >> v1:172.21.15.50:6789/0 conn(0x7fcf5c0a7960 legacy=0x7fcf5c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0a37a0 con 0x7fcf5c149620 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fcf540016d0 con 0x7fcf5c149620 2020-04-02T23:48:05.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 >> v1:172.21.15.82:6789/0 conn(0x7fcf5c149620 legacy=0x7fcf5c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:05.700 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:05.700 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf480044d0 0x7fcf48004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:05.700 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf48004db0 0x7fcf4800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:05.700 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0a23c0 con 0x7fcf48004db0 2020-04-02T23:48:05.700 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf480041c0 con 0x7fcf48003720 2020-04-02T23:48:05.700 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:05.700 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4804fb90 con 0x7fcf480044d0 2020-04-02T23:48:05.701 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6197b700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf48004db0 0x7fcf4800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:05.701 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf60979700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf480044d0 0x7fcf48004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:05.701 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 -- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf480044d0 msgr2=0x7fcf48004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:05.701 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf480044d0 0x7fcf48004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:05.701 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 -- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf48004db0 msgr2=0x7fcf4800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:05.701 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf48004db0 0x7fcf4800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:05.701 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6197b700 1 -- 172.21.15.82:0/1525238435 reap_dead start 2020-04-02T23:48:05.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 -- 172.21.15.82:0/1525238435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48003230 con 0x7fcf48003720 2020-04-02T23:48:05.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).ready entity=mon.1 client_cookie=66719a5dbed628da server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:05.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf58005c30 con 0x7fcf48003720 2020-04-02T23:48:05.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf6117a700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf58005d90 con 0x7fcf48003720 2020-04-02T23:48:05.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf53fff700 1 -- 172.21.15.82:0/1525238435 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf580112b0 con 0x7fcf48003720 2020-04-02T23:48:05.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf62bdd700 1 -- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 msgr2=0x7fcf48003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:05.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.690+0000 7fcf62bdd700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).stop 2020-04-02T23:48:05.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.691+0000 7fcf62bdd700 1 -- 172.21.15.82:0/1525238435 shutdown_connections 2020-04-02T23:48:05.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.691+0000 7fcf62bdd700 1 --2- 172.21.15.82:0/1525238435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf48003b40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:05.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.691+0000 7fcf62bdd700 1 -- 172.21.15.82:0/1525238435 >> 172.21.15.82:0/1525238435 conn(0x7fcf5c09dfb0 msgr2=0x7fcf5c09e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:05.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.691+0000 7fcf62bdd700 1 -- 172.21.15.82:0/1525238435 shutdown_connections 2020-04-02T23:48:05.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.691+0000 7fcf62bdd700 1 -- 172.21.15.82:0/1525238435 wait complete. 2020-04-02T23:48:05.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.692+0000 7fcf62bdd700 1 Processor -- start 2020-04-02T23:48:05.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.692+0000 7fcf62bdd700 1 -- start start 2020-04-02T23:48:05.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf62bdd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf48003720 0x7fcf5c0a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:05.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf62bdd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf5c064e50 0x7fcf5c1355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:05.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf62bdd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c061d60 con 0x7fcf5c135a00 2020-04-02T23:48:05.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf62bdd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0a1600 con 0x7fcf5c064e50 2020-04-02T23:48:05.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf62bdd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c062000 con 0x7fcf48003720 2020-04-02T23:48:05.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf48003720 0x7fcf5c0a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:05.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf48003720 0x7fcf5c0a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55004/0 (socket says 172.21.15.82:55004) 2020-04-02T23:48:05.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6197b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcf5c135a00 0x7fcf5c0a3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55058/0 (socket says 172.21.15.82:55058) 2020-04-02T23:48:05.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 -- 172.21.15.82:0/3368953697 learned_addr learned my addr 172.21.15.82:0/3368953697 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf60979700 1 --2- 172.21.15.82:0/3368953697 >> v2:172.21.15.50:3300/0 conn(0x7fcf5c064e50 0x7fcf5c1355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 -- 172.21.15.82:0/3368953697 >> v2:172.21.15.50:3300/0 conn(0x7fcf5c064e50 msgr2=0x7fcf5c1355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> v2:172.21.15.50:3300/0 conn(0x7fcf5c064e50 0x7fcf5c1355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 -- 172.21.15.82:0/3368953697 >> v1:172.21.15.82:6789/0 conn(0x7fcf5c135a00 legacy=0x7fcf5c0a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 -- 172.21.15.82:0/3368953697 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c067880 con 0x7fcf48003720 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965053986 0 0) 0x7fcf5c061d60 con 0x7fcf5c135a00 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> v2:172.21.15.82:3300/0 conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> v2:172.21.15.82:3300/0 conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:05.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5800f5f0 con 0x7fcf48003720 2020-04-02T23:48:05.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5800f750 con 0x7fcf48003720 2020-04-02T23:48:05.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c061a50 con 0x7fcf48003720 2020-04-02T23:48:05.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5800fb30 con 0x7fcf48003720 2020-04-02T23:48:05.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.693+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0a4520 con 0x7fcf48003720 2020-04-02T23:48:05.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.694+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.694+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c056c50 con 0x7fcf48003720 2020-04-02T23:48:05.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.694+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fcf5800fc90 con 0x7fcf48003720 2020-04-02T23:48:05.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.694+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.695+0000 7fcf51ffb700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 0x7fcf3c04f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:05.709 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.695+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcf58061880 con 0x7fcf48003720 2020-04-02T23:48:05.709 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.695+0000 7fcf60979700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 0x7fcf3c04f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:05.709 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.695+0000 7fcf60979700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 0x7fcf3c04f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf5c05bf90 tx=0x7fcf4c00c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.709 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.695+0000 7fcf60979700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 0x7fcf3c04f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf5c05bf90 tx=0x7fcf4c00c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.709 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.695+0000 7fcf60979700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 0x7fcf3c04f970 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fcf5c05bf90 tx=0x7fcf4c00c8d0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:05.710 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.698+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:05.710 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.698+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fcf5803d0a0 con 0x7fcf48003720 2020-04-02T23:48:05.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:05.881+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcf5c0a4bb0 con 0x7fcf48003720 2020-04-02T23:48:06.263 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:06.261+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:06.263 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:06.261+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v7) v1 ==== 167+0+0 (secure 0 0 0) 0x7fcf580406c0 con 0x7fcf48003720 2020-04-02T23:48:06.409 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:06.402+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcf5c05a7e0 con 0x7fcf48003720 2020-04-02T23:48:06.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:06.693+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:07.268 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.266+0000 7fcf6117a700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:07.268 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.266+0000 7fcf51ffb700 1 -- 172.21.15.82:0/3368953697 <== mon.1 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v8) v1 ==== 167+0+0 (secure 0 0 0) 0x7fcf580408a0 con 0x7fcf48003720 2020-04-02T23:48:07.270 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 msgr2=0x7fcf3c04f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:07.270 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 0x7fcf3c04f970 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fcf5c05bf90 tx=0x7fcf4c00c8d0).stop 2020-04-02T23:48:07.270 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 msgr2=0x7fcf5c0a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:07.270 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7fcf480054a0 tx=0x7fcf58010480).stop 2020-04-02T23:48:07.270 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 shutdown_connections 2020-04-02T23:48:07.271 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fcf3c04d4b0 0x7fcf3c04f970 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:07.271 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 --2- 172.21.15.82:0/3368953697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf48003720 0x7fcf5c0a11a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:07.271 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 --2- 172.21.15.82:0/3368953697 >> v2:172.21.15.50:3300/0 conn(0x7fcf5c064e50 0x7fcf5c1355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:07.271 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 >> 172.21.15.82:0/3368953697 conn(0x7fcf5c09dfb0 msgr2=0x7fcf5c069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:07.271 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 shutdown_connections 2020-04-02T23:48:07.271 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:07.268+0000 7fcf62bdd700 1 -- 172.21.15.82:0/3368953697 wait complete. 2020-04-02T23:48:07.272 INFO:tasks.workunit.client.0.smithi082.stderr:enabled new snapshots 2020-04-02T23:48:07.280 INFO:tasks.workunit.client.0.smithi082.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2020-04-02T23:48:10.030 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir foo 2020-04-02T23:48:10.038 INFO:tasks.workunit.client.0.smithi082.stderr:+ cp linux-2.6.33.tar.bz2 foo 2020-04-02T23:48:11.054 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir foo/.snap/barsnap 2020-04-02T23:48:11.336 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm foo/linux-2.6.33.tar.bz2 2020-04-02T23:48:11.347 INFO:tasks.workunit.client.0.smithi082.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2020-04-02T23:48:12.574 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 'passed: files are identical' 2020-04-02T23:48:12.574 INFO:tasks.workunit.client.0.smithi082.stderr:+ rmdir foo/.snap/barsnap 2020-04-02T23:48:12.574 INFO:tasks.workunit.client.0.smithi082.stdout:passed: files are identical 2020-04-02T23:48:12.584 INFO:tasks.workunit.client.0.smithi082.stdout:OK 2020-04-02T23:48:12.585 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo OK 2020-04-02T23:48:12.585 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:12.638 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-02T23:48:12.639 INFO:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-02T23:48:12.745 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-0.sh... 2020-04-02T23:48:12.746 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:12.759 INFO:teuthology.orchestra.run.smithi082:workunit test fs/snaps/snaptest-0.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cbb84f71d70460f911296715ab61ac09c6962b17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-0.sh 2020-04-02T23:48:12.822 INFO:tasks.workunit.client.0.smithi082.stderr:+ set -e 2020-04-02T23:48:12.823 INFO:tasks.workunit.client.0.smithi082.stderr:+ ceph fs set cephfs allow_new_snaps false 2020-04-02T23:48:12.908 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.903+0000 7fc97f716700 1 Processor -- start 2020-04-02T23:48:12.909 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97f716700 1 -- start start 2020-04-02T23:48:12.909 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97f716700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc9780a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:12.909 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97f716700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9780a24d0 0x7fc9780a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:12.909 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97f716700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780a3ac0 con 0x7fc97805aeb0 2020-04-02T23:48:12.909 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97f716700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780a4740 con 0x7fc9780a24d0 2020-04-02T23:48:12.909 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97f716700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc978061580 con 0x7fc9780ab7d0 2020-04-02T23:48:12.909 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97d4b2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9780a24d0 0x7fc9780a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97e4b4700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc97805aeb0 0x7fc97805b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55112/0 (socket says 172.21.15.82:55112) 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97e4b4700 1 -- 172.21.15.82:0/2872311787 learned_addr learned my addr 172.21.15.82:0/2872311787 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97d4b2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9780a24d0 0x7fc9780a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55062/0 (socket says 172.21.15.82:55062) 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97d4b2700 1 -- 172.21.15.82:0/2872311787 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 msgr2=0x7fc9780a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.904+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc9780a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 -- 172.21.15.82:0/2872311787 >> v1:172.21.15.82:6789/0 conn(0x7fc97805aeb0 legacy=0x7fc97805b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97ccb1700 1 -- 172.21.15.82:0/2872311787 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413703874 0 0) 0x7fc9780a3ac0 con 0x7fc97805aeb0 2020-04-02T23:48:12.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 -- 172.21.15.82:0/2872311787 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780a6590 con 0x7fc9780a24d0 2020-04-02T23:48:12.911 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/2872311787 >> v2:172.21.15.82:3300/0 conn(0x7fc9780a24d0 0x7fc9780a42e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.911 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/2872311787 >> v2:172.21.15.82:3300/0 conn(0x7fc9780a24d0 0x7fc9780a42e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.911 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9780a24d0 0x7fc9780a42e0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).ready entity=mon.1 client_cookie=a8ce7980f3dedca2 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:12.911 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9780a24d0 0x7fc9780a42e0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.911 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97ccb1700 1 -- 172.21.15.82:0/2872311787 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc974011470 con 0x7fc9780a24d0 2020-04-02T23:48:12.911 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9780a24d0 0x7fc9780a42e0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.911 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97ccb1700 1 -- 172.21.15.82:0/2872311787 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9740115d0 con 0x7fc9780a24d0 2020-04-02T23:48:12.912 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9780a24d0 0x7fc9780a42e0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.912 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97ccb1700 1 -- 172.21.15.82:0/2872311787 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9740119b0 con 0x7fc9780a24d0 2020-04-02T23:48:12.912 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 -- 172.21.15.82:0/2872311787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9780a24d0 msgr2=0x7fc9780a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:12.912 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9780a24d0 0x7fc9780a42e0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).stop 2020-04-02T23:48:12.912 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 -- 172.21.15.82:0/2872311787 shutdown_connections 2020-04-02T23:48:12.912 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc9780a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:12.912 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 --2- 172.21.15.82:0/2872311787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9780a24d0 0x7fc9780a42e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:12.913 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 -- 172.21.15.82:0/2872311787 >> 172.21.15.82:0/2872311787 conn(0x7fc978060db0 msgr2=0x7fc9780aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:12.913 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 -- 172.21.15.82:0/2872311787 shutdown_connections 2020-04-02T23:48:12.913 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.905+0000 7fc97f716700 1 -- 172.21.15.82:0/2872311787 wait complete. 2020-04-02T23:48:12.913 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97f716700 1 Processor -- start 2020-04-02T23:48:12.913 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97f716700 1 -- start start 2020-04-02T23:48:12.916 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97f716700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9780a24d0 0x7fc9781364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:12.916 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97f716700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc978129780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:12.916 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97f716700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780675a0 con 0x7fc97805aeb0 2020-04-02T23:48:12.917 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97f716700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97807ff10 con 0x7fc9780a24d0 2020-04-02T23:48:12.917 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97f716700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97806a520 con 0x7fc9780ab7d0 2020-04-02T23:48:12.917 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97e4b4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc978129780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:12.917 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.907+0000 7fc97d4b2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9780a24d0 0x7fc9781364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:12.917 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97e4b4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc978129780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:50774/0 (socket says 172.21.15.82:50774) 2020-04-02T23:48:12.917 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97e4b4700 1 -- 172.21.15.82:0/3612608973 learned_addr learned my addr 172.21.15.82:0/3612608973 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:12.917 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 -- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 msgr2=0x7fc978129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:12.918 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc978129780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:12.918 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 -- 172.21.15.82:0/3612608973 >> v1:172.21.15.50:6789/0 conn(0x7fc97805aeb0 legacy=0x7fc978064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:12.918 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 -- 172.21.15.82:0/3612608973 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9781369f0 con 0x7fc9780a24d0 2020-04-02T23:48:12.918 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97e4b4700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc978129780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:48:12.918 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> v2:172.21.15.50:3300/0 conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.918 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> v2:172.21.15.50:3300/0 conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.918 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc974007150 con 0x7fc9780a24d0 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9780a5090 con 0x7fc9780a24d0 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9740072b0 con 0x7fc9780a24d0 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.908+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9740056c0 con 0x7fc9780a24d0 2020-04-02T23:48:12.919 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.909+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780a3e10 con 0x7fc9780a24d0 2020-04-02T23:48:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.909+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.909+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97809ebb0 con 0x7fc9780a24d0 2020-04-02T23:48:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc974005940 con 0x7fc9780a24d0 2020-04-02T23:48:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc96e7fc700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 0x7fc96004f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc974061620 con 0x7fc9780a24d0 2020-04-02T23:48:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc97dcb3700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 0x7fc96004f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:12.921 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc97dcb3700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 0x7fc96004f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9780a9c10 tx=0x7fc968001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.921 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc97dcb3700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 0x7fc96004f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9780a9c10 tx=0x7fc968001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.921 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.910+0000 7fc97dcb3700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 0x7fc96004f9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fc9780a9c10 tx=0x7fc968001470).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:12.921 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.913+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:12.921 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:12.913+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc97403ce20 con 0x7fc9780a24d0 2020-04-02T23:48:13.098 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:13.096+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7fc978136b80 con 0x7fc9780a24d0 2020-04-02T23:48:13.483 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:13.481+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:13.484 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:13.481+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v9) v1 ==== 139+0+0 (secure 0 0 0) 0x7fc974040440 con 0x7fc9780a24d0 2020-04-02T23:48:13.623 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:13.621+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7fc978056c50 con 0x7fc9780a24d0 2020-04-02T23:48:13.910 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:13.908+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.487 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.486+0000 7fc97d4b2700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.488 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.486+0000 7fc96e7fc700 1 -- 172.21.15.82:0/3612608973 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v10) v1 ==== 139+0+0 (secure 0 0 0) 0x7fc974040620 con 0x7fc9780a24d0 2020-04-02T23:48:14.491 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 msgr2=0x7fc96004f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:14.491 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 0x7fc96004f9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fc9780a9c10 tx=0x7fc968001470).stop 2020-04-02T23:48:14.491 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 msgr2=0x7fc9781364a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:14.492 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fc974002f30 tx=0x7fc974007a40).stop 2020-04-02T23:48:14.492 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 shutdown_connections 2020-04-02T23:48:14.492 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fc96004d4f0 0x7fc96004f9b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:14.492 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9780ab7d0 0x7fc978129780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:14.492 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 --2- 172.21.15.82:0/3612608973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780a24d0 0x7fc9781364a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:14.493 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 >> 172.21.15.82:0/3612608973 conn(0x7fc978060db0 msgr2=0x7fc9780aa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:14.493 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 shutdown_connections 2020-04-02T23:48:14.493 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.488+0000 7fc97f716700 1 -- 172.21.15.82:0/3612608973 wait complete. 2020-04-02T23:48:14.493 INFO:tasks.workunit.client.0.smithi082.stderr:disabled new snapshots 2020-04-02T23:48:14.501 INFO:tasks.workunit.client.0.smithi082.stderr:+ expect_failure mkdir .snap/foo 2020-04-02T23:48:14.502 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir .snap/foo 2020-04-02T23:48:14.505 INFO:tasks.workunit.client.0.smithi082.stderr:mkdir: cannot create directory ‘.snap/foo’: Operation not permitted 2020-04-02T23:48:14.505 INFO:tasks.workunit.client.0.smithi082.stderr:+ return 0 2020-04-02T23:48:14.505 INFO:tasks.workunit.client.0.smithi082.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-04-02T23:48:14.600 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.592+0000 7f44a25a0700 1 Processor -- start 2020-04-02T23:48:14.600 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.592+0000 7f44a25a0700 1 -- start start 2020-04-02T23:48:14.600 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a25a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a9780 0x7f449c0a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:14.600 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a25a0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f449c0a8110 0x7f449c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:14.600 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a25a0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f449c067740 0x7f449c024b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a25a0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c0a8590 con 0x7f449c0a8110 2020-04-02T23:48:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a25a0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c080300 con 0x7f449c067740 2020-04-02T23:48:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a25a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0805a0 con 0x7f449c0a9780 2020-04-02T23:48:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a3802700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f449c067740 0x7f449c024b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a3802700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f449c067740 0x7f449c024b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55078/0 (socket says 172.21.15.82:55078) 2020-04-02T23:48:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a3802700 1 -- 172.21.15.82:0/3161145502 learned_addr learned my addr 172.21.15.82:0/3161145502 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a159e700 1 --2- 172.21.15.82:0/3161145502 >> v2:172.21.15.50:3300/0 conn(0x7f449c0a8110 0x7f449c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a9780 0x7f449c0a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.593+0000 7f44a3802700 1 -- 172.21.15.82:0/3161145502 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a9780 msgr2=0x7f449c0a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a9780 0x7f449c0a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 -- 172.21.15.82:0/3161145502 >> v2:172.21.15.50:3300/0 conn(0x7f449c0a8110 msgr2=0x7f449c0672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> v2:172.21.15.50:3300/0 conn(0x7f449c0a8110 0x7f449c0672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 -- 172.21.15.82:0/3161145502 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0a4a90 con 0x7f449c067740 2020-04-02T23:48:14.603 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a159e700 1 --2- 172.21.15.82:0/3161145502 >> v2:172.21.15.50:3300/0 conn(0x7f449c0a8110 0x7f449c0672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:48:14.603 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a9780 0x7f449c0a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:48:14.603 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> v2:172.21.15.82:3300/0 conn(0x7f449c067740 0x7f449c024b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4494002f30 tx=0x7f4494007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.603 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> v2:172.21.15.82:3300/0 conn(0x7f449c067740 0x7f449c024b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4494002f30 tx=0x7f4494007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.603 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f449c067740 0x7f449c024b20 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f4494002f30 tx=0x7f4494007a40).ready entity=mon.1 client_cookie=dd21d1f73a3bcb5c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:14.603 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f449c067740 0x7f449c024b20 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4494002f30 tx=0x7f4494007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.603 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a0d9d700 1 -- 172.21.15.82:0/3161145502 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4494011720 con 0x7f449c067740 2020-04-02T23:48:14.604 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f449c067740 0x7f449c024b20 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4494002f30 tx=0x7f4494007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.604 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a3802700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f449c067740 0x7f449c024b20 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4494002f30 tx=0x7f4494007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.604 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a0d9d700 1 -- 172.21.15.82:0/3161145502 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4494011880 con 0x7f449c067740 2020-04-02T23:48:14.604 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a0d9d700 1 -- 172.21.15.82:0/3161145502 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4494011c20 con 0x7f449c067740 2020-04-02T23:48:14.604 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 -- 172.21.15.82:0/3161145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f449c067740 msgr2=0x7f449c024b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:14.604 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f449c067740 0x7f449c024b20 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f4494002f30 tx=0x7f4494007a40).stop 2020-04-02T23:48:14.604 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 -- 172.21.15.82:0/3161145502 shutdown_connections 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f449c067740 0x7f449c024b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 --2- 172.21.15.82:0/3161145502 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a9780 0x7f449c0a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 --2- 172.21.15.82:0/3161145502 >> v2:172.21.15.50:3300/0 conn(0x7f449c0a8110 0x7f449c0672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 -- 172.21.15.82:0/3161145502 >> 172.21.15.82:0/3161145502 conn(0x7f449c0acd20 msgr2=0x7f449c0a8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.594+0000 7f44a25a0700 1 -- 172.21.15.82:0/3161145502 shutdown_connections 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.595+0000 7f44a25a0700 1 -- 172.21.15.82:0/3161145502 wait complete. 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a25a0700 1 Processor -- start 2020-04-02T23:48:14.605 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a25a0700 1 -- start start 2020-04-02T23:48:14.606 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a25a0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f449c067740 0x7f449c0a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:14.606 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a25a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a8110 0x7f449c1362b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:14.606 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a25a0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c0a58c0 con 0x7f449c0a9780 2020-04-02T23:48:14.606 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a25a0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c0a5b60 con 0x7f449c067740 2020-04-02T23:48:14.606 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a25a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0a5e00 con 0x7f449c0a8110 2020-04-02T23:48:14.606 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a159e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a8110 0x7f449c1362b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:14.606 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a1d9f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f449c067740 0x7f449c0a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a1d9f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f449c067740 0x7f449c0a2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:51670/0 (socket says 172.21.15.82:51670) 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.596+0000 7f44a1d9f700 1 -- 172.21.15.82:0/4269276592 learned_addr learned my addr 172.21.15.82:0/4269276592 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 -- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a8110 msgr2=0x7f449c1362b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a8110 0x7f449c1362b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 -- 172.21.15.82:0/4269276592 >> v1:172.21.15.50:6789/0 conn(0x7f449c0a9780 legacy=0x7f449c07f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 -- 172.21.15.82:0/4269276592 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c125a20 con 0x7f449c067740 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a159e700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a8110 0x7f449c1362b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:48:14.607 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> v2:172.21.15.50:3300/0 conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.608 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> v2:172.21.15.50:3300/0 conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.608 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:14.608 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.608 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4498007160 con 0x7f449c067740 2020-04-02T23:48:14.608 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.608 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.608 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44980072c0 con 0x7f449c067740 2020-04-02T23:48:14.609 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44980076e0 con 0x7f449c067740 2020-04-02T23:48:14.609 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c0a5420 con 0x7f449c067740 2020-04-02T23:48:14.609 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.597+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c126330 con 0x7f449c067740 2020-04-02T23:48:14.609 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.598+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.610 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.598+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c0a5700 con 0x7f449c067740 2020-04-02T23:48:14.611 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4498012450 con 0x7f449c067740 2020-04-02T23:48:14.611 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.611 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44927fc700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 0x7f448404fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:14.611 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4498060fb0 con 0x7f449c067740 2020-04-02T23:48:14.611 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44a159e700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 0x7f448404fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:14.611 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44a159e700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 0x7f448404fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f448c002f30 tx=0x7f449c05cc40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.612 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44a159e700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 0x7f448404fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f448c002f30 tx=0x7f449c05cc40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.612 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.599+0000 7f44a159e700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 0x7f448404fa50 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f448c002f30 tx=0x7f449c05cc40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:14.612 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.603+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:14.612 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.603+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f449803c6f0 con 0x7f449c067740 2020-04-02T23:48:14.790 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:14.788+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f449c056c50 con 0x7f449c067740 2020-04-02T23:48:15.494 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:15.492+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:15.495 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:15.492+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v11) v1 ==== 167+0+0 (secure 0 0 0) 0x7f449803fd10 con 0x7f449c067740 2020-04-02T23:48:15.598 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:15.596+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:15.639 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:15.637+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f44740033e0 con 0x7f449c067740 2020-04-02T23:48:16.502 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.499+0000 7f44a1d9f700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.502 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.500+0000 7f44927fc700 1 -- 172.21.15.82:0/4269276592 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v12) v1 ==== 167+0+0 (secure 0 0 0) 0x7f449803fef0 con 0x7f449c067740 2020-04-02T23:48:16.504 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 msgr2=0x7f448404fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:16.504 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 0x7f448404fa50 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f448c002f30 tx=0x7f449c05cc40).stop 2020-04-02T23:48:16.504 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 msgr2=0x7f449c0a2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:16.504 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f44980032b0 tx=0x7f449c0a9df0).stop 2020-04-02T23:48:16.505 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 shutdown_connections 2020-04-02T23:48:16.505 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f448404d590 0x7f448404fa50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:16.505 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f449c067740 0x7f449c0a2370 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:16.505 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 --2- 172.21.15.82:0/4269276592 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f449c0a8110 0x7f449c1362b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:16.505 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 >> 172.21.15.82:0/4269276592 conn(0x7f449c0acd20 msgr2=0x7f449c069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:16.505 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 shutdown_connections 2020-04-02T23:48:16.505 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:16.502+0000 7f44a25a0700 1 -- 172.21.15.82:0/4269276592 wait complete. 2020-04-02T23:48:16.506 INFO:tasks.workunit.client.0.smithi082.stderr:enabled new snapshots 2020-04-02T23:48:16.515 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo asdf 2020-04-02T23:48:16.518 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir .snap/foo 2020-04-02T23:48:16.529 INFO:tasks.workunit.client.0.smithi082.stderr:+ grep asdf .snap/foo/foo 2020-04-02T23:48:17.169 INFO:tasks.workunit.client.0.smithi082.stdout:asdf 2020-04-02T23:48:17.169 INFO:tasks.workunit.client.0.smithi082.stderr:+ rmdir .snap/foo 2020-04-02T23:48:17.177 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo asdf 2020-04-02T23:48:17.179 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir .snap/bar 2020-04-02T23:48:17.188 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm bar 2020-04-02T23:48:17.192 INFO:tasks.workunit.client.0.smithi082.stderr:+ grep asdf .snap/bar/bar 2020-04-02T23:48:17.199 INFO:tasks.workunit.client.0.smithi082.stdout:asdf 2020-04-02T23:48:17.200 INFO:tasks.workunit.client.0.smithi082.stderr:+ rmdir .snap/bar 2020-04-02T23:48:17.207 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm foo 2020-04-02T23:48:17.210 INFO:tasks.workunit.client.0.smithi082.stderr:+ ceph fs set cephfs allow_new_snaps false 2020-04-02T23:48:17.506 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.298+0000 7f2cf7e22700 1 Processor -- start 2020-04-02T23:48:17.506 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.298+0000 7f2cf7e22700 1 -- start start 2020-04-02T23:48:17.506 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf7e22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:17.507 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf7e22700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2cf00a24d0 0x7f2cf00a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:17.507 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf7e22700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00a3ac0 con 0x7f2cf005aeb0 2020-04-02T23:48:17.507 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf7e22700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00a4740 con 0x7f2cf00ab7d0 2020-04-02T23:48:17.507 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf7e22700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0061580 con 0x7f2cf00a24d0 2020-04-02T23:48:17.507 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.508 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55104/0 (socket says 172.21.15.82:55104) 2020-04-02T23:48:17.508 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 -- 172.21.15.82:0/1570897197 learned_addr learned my addr 172.21.15.82:0/1570897197 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:17.508 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf5bbe700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2cf00a24d0 0x7f2cf00a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.508 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 -- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2cf00a24d0 msgr2=0x7f2cf00a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:17.508 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2cf00a24d0 0x7f2cf00a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:17.508 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 -- 172.21.15.82:0/1570897197 >> v1:172.21.15.50:6789/0 conn(0x7f2cf005aeb0 legacy=0x7f2cf005b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.508 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 -- 172.21.15.82:0/1570897197 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00a6590 con 0x7f2cf00ab7d0 2020-04-02T23:48:17.509 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2cec0032b0 tx=0x7f2cec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.509 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 -- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 msgr2=0x7f2cf00a3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send send error: (32) Broken pipe 2020-04-02T23:48:17.509 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2cec0032b0 tx=0x7f2cec007dc0).write client ident write failed r=-32 ((32) Broken pipe) 2020-04-02T23:48:17.509 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.299+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:48:17.509 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.509 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 0 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-04-02T23:48:17.510 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:17.510 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf53bd700 1 -- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 msgr2=0x7f2cf00a3e80 unknown :-1 s=STATE_CLOSED l=0).mark_down 2020-04-02T23:48:17.510 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf53bd700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00ab7d0 0x7f2cf00a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:17.510 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf53bd700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.50:3300/0 conn(0x7f2cdc003210 0x7f2cdc005690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:17.510 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf53bd700 1 -- 172.21.15.82:0/1570897197 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc009ad0 con 0x7f2cdc005d20 2020-04-02T23:48:17.510 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf53bd700 1 -- 172.21.15.82:0/1570897197 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc04ece0 con 0x7f2cdc003210 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.50:3300/0 conn(0x7f2cdc003210 0x7f2cdc005690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 -- 172.21.15.82:0/1570897197 >> v1:172.21.15.82:6789/0 conn(0x7f2cdc005d20 legacy=0x7f2cdc0081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 -- 172.21.15.82:0/1570897197 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc04ef10 con 0x7f2cdc003210 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.50:3300/0 conn(0x7f2cdc003210 0x7f2cdc005690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2cec008c60 tx=0x7f2cf00abbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> v2:172.21.15.50:3300/0 conn(0x7f2cdc003210 0x7f2cdc005690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2cec008c60 tx=0x7f2cf00abbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.500+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cdc003210 0x7f2cdc005690 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f2cec008c60 tx=0x7f2cf00abbb0).ready entity=mon.0 client_cookie=ffe4e02416df50ac server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cdc003210 0x7f2cdc005690 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f2cec008c60 tx=0x7f2cf00abbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.511 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cdc003210 0x7f2cdc005690 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f2cec008c60 tx=0x7f2cf00abbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf53bd700 1 -- 172.21.15.82:0/1570897197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cec00fa70 con 0x7f2cdc003210 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cdc003210 0x7f2cdc005690 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f2cec008c60 tx=0x7f2cf00abbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf53bd700 1 -- 172.21.15.82:0/1570897197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec00fbd0 con 0x7f2cdc003210 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf53bd700 1 -- 172.21.15.82:0/1570897197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cec00a350 con 0x7f2cdc003210 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf7e22700 1 -- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cdc003210 msgr2=0x7f2cdc005690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf7e22700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cdc003210 0x7f2cdc005690 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f2cec008c60 tx=0x7f2cf00abbb0).stop 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.502+0000 7f2cf6bc0700 1 -- 172.21.15.82:0/1570897197 reap_dead start 2020-04-02T23:48:17.512 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.503+0000 7f2cf7e22700 1 -- 172.21.15.82:0/1570897197 shutdown_connections 2020-04-02T23:48:17.513 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.503+0000 7f2cf7e22700 1 --2- 172.21.15.82:0/1570897197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cdc003210 0x7f2cdc005690 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:17.513 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.503+0000 7f2cf7e22700 1 -- 172.21.15.82:0/1570897197 >> 172.21.15.82:0/1570897197 conn(0x7f2cf0060db0 msgr2=0x7f2cf00aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:17.513 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.503+0000 7f2cf7e22700 1 -- 172.21.15.82:0/1570897197 shutdown_connections 2020-04-02T23:48:17.513 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.503+0000 7f2cf7e22700 1 -- 172.21.15.82:0/1570897197 wait complete. 2020-04-02T23:48:17.516 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.504+0000 7f2cf7e22700 1 Processor -- start 2020-04-02T23:48:17.516 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf7e22700 1 -- start start 2020-04-02T23:48:17.516 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf7e22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2cf01336f0 0x7f2cf01256c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:17.516 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf7e22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2cf00a75e0 0x7f2cf0122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:17.522 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf7e22700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf01234e0 con 0x7f2cdc003210 2020-04-02T23:48:17.522 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf7e22700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf0123780 con 0x7f2cf01336f0 2020-04-02T23:48:17.522 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf7e22700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf0123a20 con 0x7f2cf00a75e0 2020-04-02T23:48:17.522 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf6bc0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2cf00a75e0 0x7f2cf0122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.523 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf6bc0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2cf00a75e0 0x7f2cf0122410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55118/0 (socket says 172.21.15.82:55118) 2020-04-02T23:48:17.523 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf6bc0700 1 -- 172.21.15.82:0/3022891660 learned_addr learned my addr 172.21.15.82:0/3022891660 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:17.523 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf63bf700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2cdc003210 0x7f2cf0132fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55164/0 (socket says 172.21.15.82:55164) 2020-04-02T23:48:17.523 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.505+0000 7f2cf5bbe700 1 --2- 172.21.15.82:0/3022891660 >> v2:172.21.15.50:3300/0 conn(0x7f2cf01336f0 0x7f2cf01256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.523 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 -- 172.21.15.82:0/3022891660 >> v2:172.21.15.50:3300/0 conn(0x7f2cf01336f0 msgr2=0x7f2cf01256c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.523 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> v2:172.21.15.50:3300/0 conn(0x7f2cf01336f0 0x7f2cf01256c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:17.523 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 -- 172.21.15.82:0/3022891660 >> v1:172.21.15.82:6789/0 conn(0x7f2cdc003210 legacy=0x7f2cf0132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.524 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 -- 172.21.15.82:0/3022891660 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf012a2b0 con 0x7f2cf00a75e0 2020-04-02T23:48:17.524 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.524 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> v2:172.21.15.82:3300/0 conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.524 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:17.524 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.524 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce8011e50 con 0x7f2cf00a75e0 2020-04-02T23:48:17.524 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.525 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.525 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce80058b0 con 0x7f2cf00a75e0 2020-04-02T23:48:17.527 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf01230b0 con 0x7f2cf00a75e0 2020-04-02T23:48:17.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce8005cd0 con 0x7f2cf00a75e0 2020-04-02T23:48:17.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.506+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf0122a30 con 0x7f2cf00a75e0 2020-04-02T23:48:17.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.507+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.507+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2ce800a320 con 0x7f2cf00a75e0 2020-04-02T23:48:17.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.507+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.507+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0056c50 con 0x7f2cf00a75e0 2020-04-02T23:48:17.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.508+0000 7f2ce6ffd700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 0x7f2cd804fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:17.529 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.508+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6487+0+0 (secure 0 0 0) 0x7f2ce8060890 con 0x7f2cf00a75e0 2020-04-02T23:48:17.529 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.508+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 0x7f2cd804fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.529 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.508+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 0x7f2cd804fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2cf012a1e0 tx=0x7f2cdc04f0a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.529 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.508+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 0x7f2cd804fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2cf012a1e0 tx=0x7f2cdc04f0a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.529 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.508+0000 7f2cf63bf700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 0x7f2cd804fad0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f2cf012a1e0 tx=0x7f2cdc04f0a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:17.529 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.511+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.529 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.511+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f2ce803bff0 con 0x7f2cf00a75e0 2020-04-02T23:48:17.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:17.693+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7f2cf0123b60 con 0x7f2cf00a75e0 2020-04-02T23:48:18.507 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:18.505+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:18.515 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:18.513+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:18.515 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:18.513+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v13) v1 ==== 139+0+0 (secure 0 0 0) 0x7f2ce803f610 con 0x7f2cf00a75e0 2020-04-02T23:48:18.659 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:18.657+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7f2cf005a7e0 con 0x7f2cf00a75e0 2020-04-02T23:48:19.516 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.514+0000 7f2cf6bc0700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.516 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.514+0000 7f2ce6ffd700 1 -- 172.21.15.82:0/3022891660 <== mon.1 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v14) v1 ==== 139+0+0 (secure 0 0 0) 0x7f2ce803f7f0 con 0x7f2cf00a75e0 2020-04-02T23:48:19.519 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.516+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 msgr2=0x7f2cd804fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.519 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.516+0000 7f2cf7e22700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 0x7f2cd804fad0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f2cf012a1e0 tx=0x7f2cdc04f0a0).stop 2020-04-02T23:48:19.519 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.516+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 msgr2=0x7f2cf0122410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.520 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.516+0000 7f2cf7e22700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f2cf00a7220 tx=0x7f2ce8010570).stop 2020-04-02T23:48:19.520 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.516+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 shutdown_connections 2020-04-02T23:48:19.520 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.517+0000 7f2cf7e22700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00a75e0 0x7f2cf0122410 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:19.520 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.517+0000 7f2cf7e22700 1 --2- 172.21.15.82:0/3022891660 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f2cd804d610 0x7f2cd804fad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:19.520 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.517+0000 7f2cf7e22700 1 --2- 172.21.15.82:0/3022891660 >> v2:172.21.15.50:3300/0 conn(0x7f2cf01336f0 0x7f2cf01256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:19.520 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.517+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 >> 172.21.15.82:0/3022891660 conn(0x7f2cf0060db0 msgr2=0x7f2cf0069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:19.520 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.517+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 shutdown_connections 2020-04-02T23:48:19.521 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.517+0000 7f2cf7e22700 1 -- 172.21.15.82:0/3022891660 wait complete. 2020-04-02T23:48:19.521 INFO:tasks.workunit.client.0.smithi082.stderr:disabled new snapshots 2020-04-02T23:48:19.530 INFO:tasks.workunit.client.0.smithi082.stderr:+ expect_failure mkdir .snap/baz 2020-04-02T23:48:19.530 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir .snap/baz 2020-04-02T23:48:19.534 INFO:tasks.workunit.client.0.smithi082.stderr:mkdir: cannot create directory ‘.snap/baz’: Operation not permitted 2020-04-02T23:48:19.534 INFO:tasks.workunit.client.0.smithi082.stderr:+ return 0 2020-04-02T23:48:19.534 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo OK 2020-04-02T23:48:19.535 INFO:tasks.workunit.client.0.smithi082.stdout:OK 2020-04-02T23:48:19.535 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:19.589 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-02T23:48:19.590 INFO:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-02T23:48:19.697 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2020-04-02T23:48:19.697 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:19.719 INFO:teuthology.orchestra.run.smithi082:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cbb84f71d70460f911296715ab61ac09c6962b17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2020-04-02T23:48:19.783 INFO:tasks.workunit.client.0.smithi082.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-04-02T23:48:19.876 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.867+0000 7f58ca862700 1 Processor -- start 2020-04-02T23:48:19.876 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.867+0000 7f58ca862700 1 -- start start 2020-04-02T23:48:19.876 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58ca862700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 0x7f58c4149390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58ca862700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40a2ff0 con 0x7f58c41497f0 2020-04-02T23:48:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58ca862700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40a5ac0 con 0x7f58c4080520 2020-04-02T23:48:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58ca862700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40a23c0 con 0x7f58c4148f10 2020-04-02T23:48:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c8dff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f58c4080520 0x7f58c40a7500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55172/0 (socket says 172.21.15.82:55172) 2020-04-02T23:48:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c8dff700 1 -- 172.21.15.82:0/3393975032 learned_addr learned my addr 172.21.15.82:0/3393975032 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:48:19.878 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213797694 0 0) 0x7f58c40a5ac0 con 0x7f58c4080520 2020-04-02T23:48:19.878 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b4003230 con 0x7f58c4080520 2020-04-02T23:48:19.878 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 0x7f58c4149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.878 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 451015860 0 0) 0x7f58b4003230 con 0x7f58c4080520 2020-04-02T23:48:19.878 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 msgr2=0x7f58c4149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 0x7f58c4149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 >> v1:172.21.15.50:6789/0 conn(0x7f58c41497f0 legacy=0x7f58c414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40a37a0 con 0x7f58c4080520 2020-04-02T23:48:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f58b80016d0 con 0x7f58c4080520 2020-04-02T23:48:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 >> v1:172.21.15.82:6789/0 conn(0x7f58c4080520 legacy=0x7f58c40a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 0x7f58b4003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:19.880 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:19.880 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b40045c0 0x7f58b4004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:19.880 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40a23c0 con 0x7f58b40045c0 2020-04-02T23:48:19.880 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b4004ff0 con 0x7f58b4003b80 2020-04-02T23:48:19.880 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40051b0 con 0x7f58c4148f10 2020-04-02T23:48:19.881 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.881 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.868+0000 7f58c9600700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b40045c0 0x7f58b4004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.881 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c8dff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 0x7f58b4003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.881 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 -- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 msgr2=0x7f58b4003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:19.881 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4148f10 0x7f58b4003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:19.881 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 -- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b40045c0 msgr2=0x7f58b4004a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:19.882 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b40045c0 0x7f58b4004a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:19.882 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 -- 172.21.15.82:0/3393975032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4003230 con 0x7f58b4003b80 2020-04-02T23:48:19.882 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58b0002f30 tx=0x7f58b000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.882 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58b0002f30 tx=0x7f58b000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.882 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f58b0002f30 tx=0x7f58b000ffd0).ready entity=mon.1 client_cookie=32536e1e3d78273d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:19.882 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f58b0002f30 tx=0x7f58b000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.882 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b0008dd0 con 0x7f58b4003b80 2020-04-02T23:48:19.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f58b0002f30 tx=0x7f58b000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f58b0002f30 tx=0x7f58b000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0010810 con 0x7f58b4003b80 2020-04-02T23:48:19.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c37fe700 1 -- 172.21.15.82:0/3393975032 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b0010b70 con 0x7f58b4003b80 2020-04-02T23:48:19.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58ca862700 1 -- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 msgr2=0x7f58b4004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58ca862700 1 --2- 172.21.15.82:0/3393975032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b4003b80 0x7f58b4004000 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f58b0002f30 tx=0x7f58b000ffd0).stop 2020-04-02T23:48:19.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58c9600700 1 -- 172.21.15.82:0/3393975032 reap_dead start 2020-04-02T23:48:19.884 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58ca862700 1 -- 172.21.15.82:0/3393975032 shutdown_connections 2020-04-02T23:48:19.884 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.869+0000 7f58ca862700 1 -- 172.21.15.82:0/3393975032 >> 172.21.15.82:0/3393975032 conn(0x7f58c409dfb0 msgr2=0x7f58c409e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:19.884 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.870+0000 7f58ca862700 1 -- 172.21.15.82:0/3393975032 shutdown_connections 2020-04-02T23:48:19.884 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.870+0000 7f58ca862700 1 -- 172.21.15.82:0/3393975032 wait complete. 2020-04-02T23:48:19.884 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58ca862700 1 Processor -- start 2020-04-02T23:48:19.884 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58ca862700 1 -- start start 2020-04-02T23:48:19.885 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58ca862700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4063c30 0x7f58c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:19.885 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58ca862700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58c40a1560 0x7f58c4130dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:19.885 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58ca862700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c4131230 con 0x7f58c4062020 2020-04-02T23:48:19.885 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58ca862700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40625a0 con 0x7f58c40a1560 2020-04-02T23:48:19.885 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58ca862700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40a0c30 con 0x7f58c4063c30 2020-04-02T23:48:19.885 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58c9600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58c40a1560 0x7f58c4130dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.885 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58c9600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58c40a1560 0x7f58c4130dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55136/0 (socket says 172.21.15.82:55136) 2020-04-02T23:48:19.886 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.871+0000 7f58c9600700 1 -- 172.21.15.82:0/2667557752 learned_addr learned my addr 172.21.15.82:0/2667557752 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:19.886 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 -- 172.21.15.82:0/2667557752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4063c30 msgr2=0x7f58c4067600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.886 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4063c30 0x7f58c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:19.886 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 -- 172.21.15.82:0/2667557752 >> v1:172.21.15.50:6789/0 conn(0x7f58c4062020 legacy=0x7f58c409fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.886 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 -- 172.21.15.82:0/2667557752 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40a0e20 con 0x7f58c40a1560 2020-04-02T23:48:19.886 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> v2:172.21.15.82:3300/0 conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.886 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> v2:172.21.15.82:3300/0 conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.887 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:19.887 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.887 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc013060 con 0x7f58c40a1560 2020-04-02T23:48:19.887 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.887 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.887 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc0125a0 con 0x7f58c40a1560 2020-04-02T23:48:19.887 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c40a10c0 con 0x7f58c40a1560 2020-04-02T23:48:19.888 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc012900 con 0x7f58c40a1560 2020-04-02T23:48:19.888 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c40a0310 con 0x7f58c40a1560 2020-04-02T23:48:19.888 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.888 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.873+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c4056c50 con 0x7f58c40a1560 2020-04-02T23:48:19.888 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.873+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f58bc012a60 con 0x7f58c40a1560 2020-04-02T23:48:19.888 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.873+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.888 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.873+0000 7f58c17fa700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 0x7f58a404fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:19.889 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.873+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6487+0+0 (secure 0 0 0) 0x7f58bc060d60 con 0x7f58c40a1560 2020-04-02T23:48:19.889 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.873+0000 7f58c8dff700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 0x7f58a404fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.889 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.873+0000 7f58c8dff700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 0x7f58a404fb50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58b80013e0 tx=0x7f58b80017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.889 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.874+0000 7f58c8dff700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 0x7f58a404fb50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58b80013e0 tx=0x7f58b80017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.889 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.874+0000 7f58c8dff700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 0x7f58a404fb50 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f58b80013e0 tx=0x7f58b80017c0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:19.890 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.876+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.890 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:19.876+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f58bc03c400 con 0x7f58c40a1560 2020-04-02T23:48:20.059 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:20.058+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58c40a1280 con 0x7f58c40a1560 2020-04-02T23:48:20.527 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:20.524+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.527 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:20.525+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v15) v1 ==== 167+0+0 (secure 0 0 0) 0x7f58bc03fa20 con 0x7f58c40a1560 2020-04-02T23:48:20.665 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:20.664+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58c405a7e0 con 0x7f58c40a1560 2020-04-02T23:48:20.874 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:20.872+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.526+0000 7f58c9600700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.528 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.526+0000 7f58c17fa700 1 -- 172.21.15.82:0/2667557752 <== mon.1 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v16) v1 ==== 167+0+0 (secure 0 0 0) 0x7f58bc03fc00 con 0x7f58c40a1560 2020-04-02T23:48:21.530 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 msgr2=0x7f58a404fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.530 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 0x7f58a404fb50 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f58b80013e0 tx=0x7f58b80017c0).stop 2020-04-02T23:48:21.530 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 msgr2=0x7f58c4130dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.530 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f58c40a09f0 tx=0x7f58bc010bb0).stop 2020-04-02T23:48:21.530 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 shutdown_connections 2020-04-02T23:48:21.530 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f58a404d690 0x7f58a404fb50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.531 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58c4063c30 0x7f58c4067600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.531 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 --2- 172.21.15.82:0/2667557752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40a1560 0x7f58c4130dd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.531 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 >> 172.21.15.82:0/2667557752 conn(0x7f58c409dfb0 msgr2=0x7f58c4069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:21.531 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 shutdown_connections 2020-04-02T23:48:21.531 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:21.528+0000 7f58ca862700 1 -- 172.21.15.82:0/2667557752 wait complete. 2020-04-02T23:48:21.532 INFO:tasks.workunit.client.0.smithi082.stderr:enabled new snapshots 2020-04-02T23:48:21.541 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 1 2020-04-02T23:48:21.544 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 2 2020-04-02T23:48:21.546 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 3 2020-04-02T23:48:21.548 INFO:tasks.workunit.client.0.smithi082.stderr:+ '[' -e file4 ']' 2020-04-02T23:48:21.548 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir .snap/snap1 2020-04-02T23:48:21.561 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 4 2020-04-02T23:48:21.563 INFO:tasks.workunit.client.0.smithi082.stderr:++ ls 2020-04-02T23:48:21.568 INFO:tasks.workunit.client.0.smithi082.stderr:+ now='file1 2020-04-02T23:48:21.568 INFO:tasks.workunit.client.0.smithi082.stderr:file2 2020-04-02T23:48:21.568 INFO:tasks.workunit.client.0.smithi082.stderr:file3 2020-04-02T23:48:21.568 INFO:tasks.workunit.client.0.smithi082.stderr:file4' 2020-04-02T23:48:21.569 INFO:tasks.workunit.client.0.smithi082.stderr:++ ls .snap/snap1 2020-04-02T23:48:21.573 INFO:tasks.workunit.client.0.smithi082.stderr:+ then='file1 2020-04-02T23:48:21.573 INFO:tasks.workunit.client.0.smithi082.stderr:file2 2020-04-02T23:48:21.574 INFO:tasks.workunit.client.0.smithi082.stderr:file3' 2020-04-02T23:48:21.574 INFO:tasks.workunit.client.0.smithi082.stderr:+ rmdir .snap/snap1 2020-04-02T23:48:21.580 INFO:tasks.workunit.client.0.smithi082.stderr:+ '[' 'file1 2020-04-02T23:48:21.580 INFO:tasks.workunit.client.0.smithi082.stderr:file2 2020-04-02T23:48:21.580 INFO:tasks.workunit.client.0.smithi082.stderr:file3 2020-04-02T23:48:21.580 INFO:tasks.workunit.client.0.smithi082.stderr:file4' = 'file1 2020-04-02T23:48:21.581 INFO:tasks.workunit.client.0.smithi082.stderr:file2 2020-04-02T23:48:21.581 INFO:tasks.workunit.client.0.smithi082.stderr:file3' ']' 2020-04-02T23:48:21.581 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 1 2020-04-02T23:48:21.585 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 2 2020-04-02T23:48:21.594 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 3 2020-04-02T23:48:21.597 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir .snap/snap1 2020-04-02T23:48:22.315 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 4 2020-04-02T23:48:22.323 INFO:tasks.workunit.client.0.smithi082.stderr:+ rmdir .snap/snap1 2020-04-02T23:48:22.333 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm file1 file2 file3 file4 2020-04-02T23:48:22.342 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo OK 2020-04-02T23:48:22.343 INFO:tasks.workunit.client.0.smithi082.stdout:OK 2020-04-02T23:48:22.343 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:22.399 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-02T23:48:22.400 INFO:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-02T23:48:22.508 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2020-04-02T23:48:22.508 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:22.537 INFO:teuthology.orchestra.run.smithi082:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cbb84f71d70460f911296715ab61ac09c6962b17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2020-04-02T23:48:22.693 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.687+0000 7f436a57e700 1 Processor -- start 2020-04-02T23:48:22.693 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.687+0000 7f436a57e700 1 -- start start 2020-04-02T23:48:22.693 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436a57e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4364080520 0x7f43640a7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:22.693 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436a57e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4364149620 0x7f436414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:22.693 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436a57e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43640a2ff0 con 0x7f43640a7960 2020-04-02T23:48:22.693 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436a57e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43640a23c0 con 0x7f4364080520 2020-04-02T23:48:22.694 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436a57e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43640a7e10 con 0x7f4364149620 2020-04-02T23:48:22.694 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436931c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4364149620 0x7f436414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.694 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f4368b1b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4364080520 0x7f43640a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.694 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436931c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4364149620 0x7f436414ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:50854/0 (socket says 172.21.15.82:50854) 2020-04-02T23:48:22.694 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f436931c700 1 -- 172.21.15.82:0/825884361 learned_addr learned my addr 172.21.15.82:0/825884361 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:48:22.694 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.688+0000 7f4368b1b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4364080520 0x7f43640a7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:51728/0 (socket says 172.21.15.82:51728) 2020-04-02T23:48:22.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 -- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4364149620 msgr2=0x7f436414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:22.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4364149620 0x7f436414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:22.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 -- 172.21.15.82:0/825884361 >> v1:172.21.15.50:6789/0 conn(0x7f43640a7960 legacy=0x7f4364148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 -- 172.21.15.82:0/825884361 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640a5ac0 con 0x7f4364080520 2020-04-02T23:48:22.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f43637fe700 1 -- 172.21.15.82:0/825884361 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176186412 0 0) 0x7f43640a2ff0 con 0x7f43640a7960 2020-04-02T23:48:22.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f436931c700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4364149620 0x7f436414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:48:22.695 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 --2- 172.21.15.82:0/825884361 >> v2:172.21.15.50:3300/0 conn(0x7f4364080520 0x7f43640a7500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4354002f30 tx=0x7f4354007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.696 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 --2- 172.21.15.82:0/825884361 >> v2:172.21.15.50:3300/0 conn(0x7f4364080520 0x7f43640a7500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4354002f30 tx=0x7f4354007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.696 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4364080520 0x7f43640a7500 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f4354002f30 tx=0x7f4354007a40).ready entity=mon.0 client_cookie=fdb642de1aeb0633 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.696 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4364080520 0x7f43640a7500 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f4354002f30 tx=0x7f4354007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f43637fe700 1 -- 172.21.15.82:0/825884361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43540113c0 con 0x7f4364080520 2020-04-02T23:48:22.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4364080520 0x7f43640a7500 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f4354002f30 tx=0x7f4354007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f43637fe700 1 -- 172.21.15.82:0/825884361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354011520 con 0x7f4364080520 2020-04-02T23:48:22.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f4368b1b700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4364080520 0x7f43640a7500 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f4354002f30 tx=0x7f4354007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f43637fe700 1 -- 172.21.15.82:0/825884361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4354011900 con 0x7f4364080520 2020-04-02T23:48:22.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f436a57e700 1 -- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4364080520 msgr2=0x7f43640a7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.697 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.689+0000 7f436a57e700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4364080520 0x7f43640a7500 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f4354002f30 tx=0x7f4354007a40).stop 2020-04-02T23:48:22.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.690+0000 7f436a57e700 1 -- 172.21.15.82:0/825884361 shutdown_connections 2020-04-02T23:48:22.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.690+0000 7f436a57e700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4364149620 0x7f436414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:22.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.690+0000 7f436a57e700 1 --2- 172.21.15.82:0/825884361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4364080520 0x7f43640a7500 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.690+0000 7f436a57e700 1 -- 172.21.15.82:0/825884361 >> 172.21.15.82:0/825884361 conn(0x7f436409dfb0 msgr2=0x7f436409e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:22.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.690+0000 7f436a57e700 1 -- 172.21.15.82:0/825884361 shutdown_connections 2020-04-02T23:48:22.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.690+0000 7f436a57e700 1 -- 172.21.15.82:0/825884361 wait complete. 2020-04-02T23:48:22.698 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.691+0000 7f436a57e700 1 Processor -- start 2020-04-02T23:48:22.699 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.691+0000 7f436a57e700 1 -- start start 2020-04-02T23:48:22.702 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.691+0000 7f436a57e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.691+0000 7f436a57e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43640a0b30 con 0x7f4364080520 2020-04-02T23:48:22.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.691+0000 7f436a57e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43640a0dd0 con 0x7f4364149620 2020-04-02T23:48:22.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.691+0000 7f436a57e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43640a1820 con 0x7f43640a7960 2020-04-02T23:48:22.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f436931c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4364149620 0x7f436407f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55204/0 (socket says 172.21.15.82:55204) 2020-04-02T23:48:22.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f436931c700 1 -- 172.21.15.82:0/2529807669 learned_addr learned my addr 172.21.15.82:0/2529807669 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:48:22.703 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356803220 0 0) 0x7f43640a0dd0 con 0x7f4364149620 2020-04-02T23:48:22.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4344003230 con 0x7f4364149620 2020-04-02T23:48:22.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589028876 0 0) 0x7f43640a0b30 con 0x7f4364080520 2020-04-02T23:48:22.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43640a0dd0 con 0x7f4364080520 2020-04-02T23:48:22.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 352289332 0 0) 0x7f4344003230 con 0x7f4364149620 2020-04-02T23:48:22.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 -- 172.21.15.82:0/2529807669 >> v1:172.21.15.82:6789/0 conn(0x7f4364149620 legacy=0x7f436407f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.704 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 -- 172.21.15.82:0/2529807669 >> v1:172.21.15.50:6789/0 conn(0x7f4364080520 legacy=0x7f436409f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 -- 172.21.15.82:0/2529807669 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43641248d0 con 0x7f43640a7960 2020-04-02T23:48:22.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4358001ea0 con 0x7f43640a7960 2020-04-02T23:48:22.705 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435800cb00 con 0x7f43640a7960 2020-04-02T23:48:22.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f435c002840 con 0x7f43640a7960 2020-04-02T23:48:22.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436407fa40 con 0x7f43640a7960 2020-04-02T23:48:22.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.692+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43640a1270 con 0x7f43640a7960 2020-04-02T23:48:22.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.693+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.706 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.693+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43640a0f60 con 0x7f43640a7960 2020-04-02T23:48:22.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f43580064e0 con 0x7f43640a7960 2020-04-02T23:48:22.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f43617fa700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 0x7f434404fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6487+0+0 (secure 0 0 0) 0x7f43580604a0 con 0x7f43640a7960 2020-04-02T23:48:22.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f4368b1b700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 0x7f434404fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f4368b1b700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 0x7f434404fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43540088e0 tx=0x7f4354007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.707 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f4368b1b700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 0x7f434404fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43540088e0 tx=0x7f4354007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.694+0000 7f4368b1b700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 0x7f434404fea0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f43540088e0 tx=0x7f4354007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.697+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.708 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.697+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f435803bbe0 con 0x7f43640a7960 2020-04-02T23:48:22.883 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:22.881+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4364124ac0 con 0x7f43640a7960 2020-04-02T23:48:23.534 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:23.532+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.534 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:23.532+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v17) v1 ==== 167+0+0 (secure 0 0 0) 0x7f435800ce60 con 0x7f43640a7960 2020-04-02T23:48:23.677 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:23.675+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4364056c50 con 0x7f43640a7960 2020-04-02T23:48:23.694 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:23.692+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.538 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.536+0000 7f4363fff700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.538 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.536+0000 7f43617fa700 1 -- 172.21.15.82:0/2529807669 <== mon.2 v2:172.21.15.50:3301/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) v1 ==== 167+0+0 (secure 0 0 0) 0x7f435803f200 con 0x7f43640a7960 2020-04-02T23:48:24.541 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 msgr2=0x7f434404fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.541 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 0x7f434404fea0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f43540088e0 tx=0x7f4354007a40).stop 2020-04-02T23:48:24.541 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 msgr2=0x7f43640677b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.541 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f43580013a0 tx=0x7f4358001e40).stop 2020-04-02T23:48:24.541 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 shutdown_connections 2020-04-02T23:48:24.541 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f434404d9e0 0x7f434404fea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:24.542 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 --2- 172.21.15.82:0/2529807669 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43640a7960 0x7f43640677b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:24.542 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 >> 172.21.15.82:0/2529807669 conn(0x7f436409dfb0 msgr2=0x7f4364148ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:24.542 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 shutdown_connections 2020-04-02T23:48:24.542 INFO:tasks.workunit.client.0.smithi082.stderr:2020-04-02T23:48:24.539+0000 7f436a57e700 1 -- 172.21.15.82:0/2529807669 wait complete. 2020-04-02T23:48:24.542 INFO:tasks.workunit.client.0.smithi082.stderr:enabled new snapshots 2020-04-02T23:48:24.552 INFO:tasks.workunit.client.0.smithi082.stdout:Create dir 100 to 199 ... 2020-04-02T23:48:24.564 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 100 2020-04-02T23:48:24.590 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 101 2020-04-02T23:48:24.941 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 102 2020-04-02T23:48:24.967 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 103 2020-04-02T23:48:24.990 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 104 2020-04-02T23:48:25.012 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 105 2020-04-02T23:48:25.035 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 106 2020-04-02T23:48:25.056 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 107 2020-04-02T23:48:25.165 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:48:25.181 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:25.224 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:25.238 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:25.903 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 108 2020-04-02T23:48:25.928 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 109 2020-04-02T23:48:25.951 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 110 2020-04-02T23:48:25.973 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 111 2020-04-02T23:48:25.994 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 112 2020-04-02T23:48:26.017 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 113 2020-04-02T23:48:26.035 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 114 2020-04-02T23:48:26.055 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 115 2020-04-02T23:48:26.075 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 116 2020-04-02T23:48:26.094 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 117 2020-04-02T23:48:26.115 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 118 2020-04-02T23:48:26.133 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 119 2020-04-02T23:48:26.154 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 120 2020-04-02T23:48:26.174 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 121 2020-04-02T23:48:26.635 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 122 2020-04-02T23:48:26.675 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 123 2020-04-02T23:48:26.707 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 124 2020-04-02T23:48:26.740 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 125 2020-04-02T23:48:26.762 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 126 2020-04-02T23:48:26.782 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 127 2020-04-02T23:48:26.803 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 128 2020-04-02T23:48:26.825 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 129 2020-04-02T23:48:26.847 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 130 2020-04-02T23:48:26.870 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 131 2020-04-02T23:48:26.893 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 132 2020-04-02T23:48:26.913 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 133 2020-04-02T23:48:26.935 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 134 2020-04-02T23:48:26.956 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 135 2020-04-02T23:48:26.979 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 136 2020-04-02T23:48:27.000 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 137 2020-04-02T23:48:27.022 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 138 2020-04-02T23:48:27.045 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 139 2020-04-02T23:48:27.833 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 140 2020-04-02T23:48:27.859 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 141 2020-04-02T23:48:27.883 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 142 2020-04-02T23:48:27.907 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 143 2020-04-02T23:48:27.930 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 144 2020-04-02T23:48:27.952 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 145 2020-04-02T23:48:27.974 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 146 2020-04-02T23:48:27.996 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 147 2020-04-02T23:48:28.018 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 148 2020-04-02T23:48:28.045 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 149 2020-04-02T23:48:28.061 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 150 2020-04-02T23:48:28.082 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 151 2020-04-02T23:48:28.103 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 152 2020-04-02T23:48:28.126 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 153 2020-04-02T23:48:28.147 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 154 2020-04-02T23:48:28.167 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 155 2020-04-02T23:48:28.187 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 156 2020-04-02T23:48:28.206 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 157 2020-04-02T23:48:28.229 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 158 2020-04-02T23:48:28.247 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 159 2020-04-02T23:48:28.267 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 160 2020-04-02T23:48:28.289 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 161 2020-04-02T23:48:28.311 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 162 2020-04-02T23:48:28.330 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 163 2020-04-02T23:48:28.358 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 164 2020-04-02T23:48:28.378 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 165 2020-04-02T23:48:28.398 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 166 2020-04-02T23:48:28.419 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 167 2020-04-02T23:48:28.441 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 168 2020-04-02T23:48:28.464 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 169 2020-04-02T23:48:29.331 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 170 2020-04-02T23:48:29.356 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 171 2020-04-02T23:48:29.381 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 172 2020-04-02T23:48:29.404 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 173 2020-04-02T23:48:29.425 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 174 2020-04-02T23:48:29.446 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 175 2020-04-02T23:48:29.466 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 176 2020-04-02T23:48:29.486 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 177 2020-04-02T23:48:29.507 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 178 2020-04-02T23:48:29.529 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 179 2020-04-02T23:48:29.549 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 180 2020-04-02T23:48:29.570 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 181 2020-04-02T23:48:29.594 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 182 2020-04-02T23:48:30.076 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 183 2020-04-02T23:48:30.097 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 184 2020-04-02T23:48:30.118 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 185 2020-04-02T23:48:30.139 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 186 2020-04-02T23:48:30.161 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 187 2020-04-02T23:48:30.181 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 188 2020-04-02T23:48:30.203 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 189 2020-04-02T23:48:30.226 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 190 2020-04-02T23:48:30.248 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 191 2020-04-02T23:48:30.267 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 192 2020-04-02T23:48:30.289 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 193 2020-04-02T23:48:30.309 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 194 2020-04-02T23:48:30.331 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 195 2020-04-02T23:48:30.354 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 196 2020-04-02T23:48:30.374 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 197 2020-04-02T23:48:30.395 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 198 2020-04-02T23:48:30.417 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 199 2020-04-02T23:48:30.441 INFO:tasks.workunit.client.0.smithi082.stdout:Take first snapshot .snap/test1 2020-04-02T23:48:30.576 INFO:tasks.workunit.client.0.smithi082.stdout:Create dir 200 to 299 ... 2020-04-02T23:48:30.577 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 200 2020-04-02T23:48:31.476 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 201 2020-04-02T23:48:31.497 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 202 2020-04-02T23:48:31.518 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 203 2020-04-02T23:48:31.537 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 204 2020-04-02T23:48:31.557 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 205 2020-04-02T23:48:31.577 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 206 2020-04-02T23:48:31.597 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 207 2020-04-02T23:48:31.640 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 208 2020-04-02T23:48:32.118 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 209 2020-04-02T23:48:32.138 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 210 2020-04-02T23:48:32.158 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 211 2020-04-02T23:48:32.178 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 212 2020-04-02T23:48:32.198 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 213 2020-04-02T23:48:32.217 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 214 2020-04-02T23:48:32.236 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 215 2020-04-02T23:48:32.256 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 216 2020-04-02T23:48:32.276 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 217 2020-04-02T23:48:32.295 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 218 2020-04-02T23:48:32.316 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 219 2020-04-02T23:48:32.336 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 220 2020-04-02T23:48:32.355 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 221 2020-04-02T23:48:32.433 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 222 2020-04-02T23:48:32.454 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 223 2020-04-02T23:48:32.474 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 224 2020-04-02T23:48:32.494 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 225 2020-04-02T23:48:32.514 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 226 2020-04-02T23:48:32.534 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 227 2020-04-02T23:48:32.554 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 228 2020-04-02T23:48:32.573 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 229 2020-04-02T23:48:32.593 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 230 2020-04-02T23:48:32.612 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 231 2020-04-02T23:48:33.025 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 232 2020-04-02T23:48:33.046 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 233 2020-04-02T23:48:33.371 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 234 2020-04-02T23:48:33.395 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 235 2020-04-02T23:48:33.418 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 236 2020-04-02T23:48:33.441 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 237 2020-04-02T23:48:33.463 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 238 2020-04-02T23:48:33.484 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 239 2020-04-02T23:48:33.506 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 240 2020-04-02T23:48:33.527 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 241 2020-04-02T23:48:33.601 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 242 2020-04-02T23:48:33.621 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 243 2020-04-02T23:48:33.641 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 244 2020-04-02T23:48:33.660 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 245 2020-04-02T23:48:33.680 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 246 2020-04-02T23:48:33.699 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 247 2020-04-02T23:48:33.718 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 248 2020-04-02T23:48:33.738 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 249 2020-04-02T23:48:33.758 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 250 2020-04-02T23:48:33.789 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 251 2020-04-02T23:48:36.075 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 252 2020-04-02T23:48:36.095 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 253 2020-04-02T23:48:36.115 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 254 2020-04-02T23:48:36.135 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 255 2020-04-02T23:48:36.155 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 256 2020-04-02T23:48:36.175 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 257 2020-04-02T23:48:36.194 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 258 2020-04-02T23:48:36.214 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 259 2020-04-02T23:48:36.235 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 260 2020-04-02T23:48:36.255 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 261 2020-04-02T23:48:36.275 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 262 2020-04-02T23:48:36.294 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 263 2020-04-02T23:48:36.314 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 264 2020-04-02T23:48:36.334 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 265 2020-04-02T23:48:36.354 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 266 2020-04-02T23:48:36.376 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 267 2020-04-02T23:48:36.393 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 268 2020-04-02T23:48:36.412 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 269 2020-04-02T23:48:36.431 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 270 2020-04-02T23:48:36.450 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 271 2020-04-02T23:48:36.470 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 272 2020-04-02T23:48:36.490 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 273 2020-04-02T23:48:36.510 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 274 2020-04-02T23:48:36.529 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 275 2020-04-02T23:48:36.547 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 276 2020-04-02T23:48:36.567 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 277 2020-04-02T23:48:36.617 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 278 2020-04-02T23:48:36.650 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 279 2020-04-02T23:48:36.682 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 280 2020-04-02T23:48:36.713 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 281 2020-04-02T23:48:36.746 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 282 2020-04-02T23:48:36.775 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 283 2020-04-02T23:48:36.804 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 284 2020-04-02T23:48:36.836 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 285 2020-04-02T23:48:36.856 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 286 2020-04-02T23:48:36.879 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 287 2020-04-02T23:48:36.902 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 288 2020-04-02T23:48:37.003 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 289 2020-04-02T23:48:37.086 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 290 2020-04-02T23:48:37.105 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 291 2020-04-02T23:48:37.126 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 292 2020-04-02T23:48:37.146 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 293 2020-04-02T23:48:37.165 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 294 2020-04-02T23:48:37.185 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 295 2020-04-02T23:48:37.204 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 296 2020-04-02T23:48:37.224 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 297 2020-04-02T23:48:37.243 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 298 2020-04-02T23:48:37.264 INFO:tasks.workunit.client.0.smithi082.stdout: create dir 299 2020-04-02T23:48:37.285 INFO:tasks.workunit.client.0.smithi082.stdout:Create a snapshot in every first level dir ... 2020-04-02T23:48:37.369 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/.snap/snap-subdir-test 2020-04-02T23:48:37.387 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/30 file after the snapshot 2020-04-02T23:48:37.388 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/31 file after the snapshot 2020-04-02T23:48:37.390 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/32 file after the snapshot 2020-04-02T23:48:37.392 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/33 file after the snapshot 2020-04-02T23:48:37.394 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/34 file after the snapshot 2020-04-02T23:48:37.395 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/35 file after the snapshot 2020-04-02T23:48:37.397 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/36 file after the snapshot 2020-04-02T23:48:37.399 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/37 file after the snapshot 2020-04-02T23:48:37.401 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/38 file after the snapshot 2020-04-02T23:48:37.403 INFO:tasks.workunit.client.0.smithi082.stdout: create 100/39 file after the snapshot 2020-04-02T23:48:37.404 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/.snap/snap-subdir-test 2020-04-02T23:48:37.428 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/30 file after the snapshot 2020-04-02T23:48:37.430 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/31 file after the snapshot 2020-04-02T23:48:37.432 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/32 file after the snapshot 2020-04-02T23:48:37.433 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/33 file after the snapshot 2020-04-02T23:48:37.436 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/34 file after the snapshot 2020-04-02T23:48:37.438 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/35 file after the snapshot 2020-04-02T23:48:37.439 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/36 file after the snapshot 2020-04-02T23:48:37.441 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/37 file after the snapshot 2020-04-02T23:48:37.443 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/38 file after the snapshot 2020-04-02T23:48:37.444 INFO:tasks.workunit.client.0.smithi082.stdout: create 101/39 file after the snapshot 2020-04-02T23:48:37.446 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/.snap/snap-subdir-test 2020-04-02T23:48:37.467 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/30 file after the snapshot 2020-04-02T23:48:37.469 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/31 file after the snapshot 2020-04-02T23:48:37.470 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/32 file after the snapshot 2020-04-02T23:48:37.471 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/33 file after the snapshot 2020-04-02T23:48:37.475 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/34 file after the snapshot 2020-04-02T23:48:37.475 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/35 file after the snapshot 2020-04-02T23:48:37.477 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/36 file after the snapshot 2020-04-02T23:48:37.479 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/37 file after the snapshot 2020-04-02T23:48:37.481 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/38 file after the snapshot 2020-04-02T23:48:37.483 INFO:tasks.workunit.client.0.smithi082.stdout: create 102/39 file after the snapshot 2020-04-02T23:48:37.485 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/.snap/snap-subdir-test 2020-04-02T23:48:37.514 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/30 file after the snapshot 2020-04-02T23:48:37.515 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/31 file after the snapshot 2020-04-02T23:48:37.517 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/32 file after the snapshot 2020-04-02T23:48:37.518 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/33 file after the snapshot 2020-04-02T23:48:37.520 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/34 file after the snapshot 2020-04-02T23:48:37.522 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/35 file after the snapshot 2020-04-02T23:48:37.523 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/36 file after the snapshot 2020-04-02T23:48:37.525 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/37 file after the snapshot 2020-04-02T23:48:37.527 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/38 file after the snapshot 2020-04-02T23:48:37.529 INFO:tasks.workunit.client.0.smithi082.stdout: create 103/39 file after the snapshot 2020-04-02T23:48:37.530 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/.snap/snap-subdir-test 2020-04-02T23:48:37.551 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/30 file after the snapshot 2020-04-02T23:48:37.553 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/31 file after the snapshot 2020-04-02T23:48:37.554 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/32 file after the snapshot 2020-04-02T23:48:37.556 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/33 file after the snapshot 2020-04-02T23:48:37.560 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/34 file after the snapshot 2020-04-02T23:48:37.561 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/35 file after the snapshot 2020-04-02T23:48:37.562 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/36 file after the snapshot 2020-04-02T23:48:37.564 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/37 file after the snapshot 2020-04-02T23:48:37.565 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/38 file after the snapshot 2020-04-02T23:48:37.567 INFO:tasks.workunit.client.0.smithi082.stdout: create 104/39 file after the snapshot 2020-04-02T23:48:37.569 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/.snap/snap-subdir-test 2020-04-02T23:48:37.590 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/30 file after the snapshot 2020-04-02T23:48:37.591 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/31 file after the snapshot 2020-04-02T23:48:37.593 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/32 file after the snapshot 2020-04-02T23:48:37.595 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/33 file after the snapshot 2020-04-02T23:48:37.596 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/34 file after the snapshot 2020-04-02T23:48:37.598 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/35 file after the snapshot 2020-04-02T23:48:37.600 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/36 file after the snapshot 2020-04-02T23:48:37.602 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/37 file after the snapshot 2020-04-02T23:48:37.603 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/38 file after the snapshot 2020-04-02T23:48:37.605 INFO:tasks.workunit.client.0.smithi082.stdout: create 105/39 file after the snapshot 2020-04-02T23:48:37.607 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/.snap/snap-subdir-test 2020-04-02T23:48:37.628 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/30 file after the snapshot 2020-04-02T23:48:37.630 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/31 file after the snapshot 2020-04-02T23:48:37.632 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/32 file after the snapshot 2020-04-02T23:48:37.633 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/33 file after the snapshot 2020-04-02T23:48:37.635 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/34 file after the snapshot 2020-04-02T23:48:37.637 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/35 file after the snapshot 2020-04-02T23:48:37.639 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/36 file after the snapshot 2020-04-02T23:48:37.640 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/37 file after the snapshot 2020-04-02T23:48:37.643 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/38 file after the snapshot 2020-04-02T23:48:37.645 INFO:tasks.workunit.client.0.smithi082.stdout: create 106/39 file after the snapshot 2020-04-02T23:48:37.646 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/.snap/snap-subdir-test 2020-04-02T23:48:37.668 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/30 file after the snapshot 2020-04-02T23:48:37.669 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/31 file after the snapshot 2020-04-02T23:48:37.671 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/32 file after the snapshot 2020-04-02T23:48:37.673 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/33 file after the snapshot 2020-04-02T23:48:37.675 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/34 file after the snapshot 2020-04-02T23:48:37.677 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/35 file after the snapshot 2020-04-02T23:48:37.678 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/36 file after the snapshot 2020-04-02T23:48:37.680 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/37 file after the snapshot 2020-04-02T23:48:37.682 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/38 file after the snapshot 2020-04-02T23:48:37.685 INFO:tasks.workunit.client.0.smithi082.stdout: create 107/39 file after the snapshot 2020-04-02T23:48:37.685 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/.snap/snap-subdir-test 2020-04-02T23:48:37.707 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/30 file after the snapshot 2020-04-02T23:48:37.708 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/31 file after the snapshot 2020-04-02T23:48:37.710 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/32 file after the snapshot 2020-04-02T23:48:37.712 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/33 file after the snapshot 2020-04-02T23:48:37.713 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/34 file after the snapshot 2020-04-02T23:48:37.715 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/35 file after the snapshot 2020-04-02T23:48:37.717 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/36 file after the snapshot 2020-04-02T23:48:37.718 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/37 file after the snapshot 2020-04-02T23:48:37.720 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/38 file after the snapshot 2020-04-02T23:48:37.722 INFO:tasks.workunit.client.0.smithi082.stdout: create 108/39 file after the snapshot 2020-04-02T23:48:37.723 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/.snap/snap-subdir-test 2020-04-02T23:48:37.852 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/30 file after the snapshot 2020-04-02T23:48:37.852 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/31 file after the snapshot 2020-04-02T23:48:37.853 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/32 file after the snapshot 2020-04-02T23:48:37.853 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/33 file after the snapshot 2020-04-02T23:48:37.853 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/34 file after the snapshot 2020-04-02T23:48:37.853 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/35 file after the snapshot 2020-04-02T23:48:37.854 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/36 file after the snapshot 2020-04-02T23:48:37.856 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/37 file after the snapshot 2020-04-02T23:48:37.857 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/38 file after the snapshot 2020-04-02T23:48:37.859 INFO:tasks.workunit.client.0.smithi082.stdout: create 109/39 file after the snapshot 2020-04-02T23:48:37.861 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/.snap/snap-subdir-test 2020-04-02T23:48:37.882 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/30 file after the snapshot 2020-04-02T23:48:37.884 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/31 file after the snapshot 2020-04-02T23:48:37.886 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/32 file after the snapshot 2020-04-02T23:48:37.887 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/33 file after the snapshot 2020-04-02T23:48:37.889 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/34 file after the snapshot 2020-04-02T23:48:37.891 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/35 file after the snapshot 2020-04-02T23:48:37.893 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/36 file after the snapshot 2020-04-02T23:48:37.895 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/37 file after the snapshot 2020-04-02T23:48:37.896 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/38 file after the snapshot 2020-04-02T23:48:37.898 INFO:tasks.workunit.client.0.smithi082.stdout: create 110/39 file after the snapshot 2020-04-02T23:48:37.900 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/.snap/snap-subdir-test 2020-04-02T23:48:37.928 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/30 file after the snapshot 2020-04-02T23:48:37.929 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/31 file after the snapshot 2020-04-02T23:48:37.931 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/32 file after the snapshot 2020-04-02T23:48:37.933 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/33 file after the snapshot 2020-04-02T23:48:37.935 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/34 file after the snapshot 2020-04-02T23:48:37.936 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/35 file after the snapshot 2020-04-02T23:48:37.938 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/36 file after the snapshot 2020-04-02T23:48:37.940 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/37 file after the snapshot 2020-04-02T23:48:37.942 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/38 file after the snapshot 2020-04-02T23:48:37.944 INFO:tasks.workunit.client.0.smithi082.stdout: create 111/39 file after the snapshot 2020-04-02T23:48:37.946 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/.snap/snap-subdir-test 2020-04-02T23:48:37.981 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/30 file after the snapshot 2020-04-02T23:48:38.070 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/31 file after the snapshot 2020-04-02T23:48:38.071 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/32 file after the snapshot 2020-04-02T23:48:38.073 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/33 file after the snapshot 2020-04-02T23:48:38.075 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/34 file after the snapshot 2020-04-02T23:48:38.077 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/35 file after the snapshot 2020-04-02T23:48:38.079 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/36 file after the snapshot 2020-04-02T23:48:38.082 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/37 file after the snapshot 2020-04-02T23:48:38.083 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/38 file after the snapshot 2020-04-02T23:48:38.085 INFO:tasks.workunit.client.0.smithi082.stdout: create 112/39 file after the snapshot 2020-04-02T23:48:38.087 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/.snap/snap-subdir-test 2020-04-02T23:48:39.061 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/30 file after the snapshot 2020-04-02T23:48:39.062 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/31 file after the snapshot 2020-04-02T23:48:39.064 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/32 file after the snapshot 2020-04-02T23:48:39.066 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/33 file after the snapshot 2020-04-02T23:48:39.068 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/34 file after the snapshot 2020-04-02T23:48:39.069 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/35 file after the snapshot 2020-04-02T23:48:39.071 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/36 file after the snapshot 2020-04-02T23:48:39.073 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/37 file after the snapshot 2020-04-02T23:48:39.074 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/38 file after the snapshot 2020-04-02T23:48:39.076 INFO:tasks.workunit.client.0.smithi082.stdout: create 113/39 file after the snapshot 2020-04-02T23:48:39.078 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/.snap/snap-subdir-test 2020-04-02T23:48:39.135 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/30 file after the snapshot 2020-04-02T23:48:39.137 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/31 file after the snapshot 2020-04-02T23:48:39.138 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/32 file after the snapshot 2020-04-02T23:48:39.140 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/33 file after the snapshot 2020-04-02T23:48:39.142 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/34 file after the snapshot 2020-04-02T23:48:39.144 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/35 file after the snapshot 2020-04-02T23:48:39.146 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/36 file after the snapshot 2020-04-02T23:48:39.148 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/37 file after the snapshot 2020-04-02T23:48:39.151 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/38 file after the snapshot 2020-04-02T23:48:39.151 INFO:tasks.workunit.client.0.smithi082.stdout: create 114/39 file after the snapshot 2020-04-02T23:48:39.153 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/.snap/snap-subdir-test 2020-04-02T23:48:39.576 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/30 file after the snapshot 2020-04-02T23:48:39.578 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/31 file after the snapshot 2020-04-02T23:48:39.580 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/32 file after the snapshot 2020-04-02T23:48:39.581 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/33 file after the snapshot 2020-04-02T23:48:39.583 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/34 file after the snapshot 2020-04-02T23:48:39.585 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/35 file after the snapshot 2020-04-02T23:48:39.587 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/36 file after the snapshot 2020-04-02T23:48:39.589 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/37 file after the snapshot 2020-04-02T23:48:39.590 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/38 file after the snapshot 2020-04-02T23:48:39.592 INFO:tasks.workunit.client.0.smithi082.stdout: create 115/39 file after the snapshot 2020-04-02T23:48:39.593 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/.snap/snap-subdir-test 2020-04-02T23:48:39.615 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/30 file after the snapshot 2020-04-02T23:48:39.617 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/31 file after the snapshot 2020-04-02T23:48:39.619 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/32 file after the snapshot 2020-04-02T23:48:39.620 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/33 file after the snapshot 2020-04-02T23:48:39.622 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/34 file after the snapshot 2020-04-02T23:48:39.624 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/35 file after the snapshot 2020-04-02T23:48:39.625 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/36 file after the snapshot 2020-04-02T23:48:39.627 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/37 file after the snapshot 2020-04-02T23:48:39.629 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/38 file after the snapshot 2020-04-02T23:48:39.631 INFO:tasks.workunit.client.0.smithi082.stdout: create 116/39 file after the snapshot 2020-04-02T23:48:39.633 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/.snap/snap-subdir-test 2020-04-02T23:48:39.662 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/30 file after the snapshot 2020-04-02T23:48:39.664 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/31 file after the snapshot 2020-04-02T23:48:39.665 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/32 file after the snapshot 2020-04-02T23:48:39.667 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/33 file after the snapshot 2020-04-02T23:48:39.669 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/34 file after the snapshot 2020-04-02T23:48:39.671 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/35 file after the snapshot 2020-04-02T23:48:39.674 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/36 file after the snapshot 2020-04-02T23:48:39.675 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/37 file after the snapshot 2020-04-02T23:48:39.677 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/38 file after the snapshot 2020-04-02T23:48:39.679 INFO:tasks.workunit.client.0.smithi082.stdout: create 117/39 file after the snapshot 2020-04-02T23:48:39.681 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/.snap/snap-subdir-test 2020-04-02T23:48:40.443 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/30 file after the snapshot 2020-04-02T23:48:40.445 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/31 file after the snapshot 2020-04-02T23:48:40.447 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/32 file after the snapshot 2020-04-02T23:48:40.449 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/33 file after the snapshot 2020-04-02T23:48:40.452 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/34 file after the snapshot 2020-04-02T23:48:40.454 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/35 file after the snapshot 2020-04-02T23:48:40.456 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/36 file after the snapshot 2020-04-02T23:48:40.459 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/37 file after the snapshot 2020-04-02T23:48:40.461 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/38 file after the snapshot 2020-04-02T23:48:40.463 INFO:tasks.workunit.client.0.smithi082.stdout: create 118/39 file after the snapshot 2020-04-02T23:48:40.466 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/.snap/snap-subdir-test 2020-04-02T23:48:40.498 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/30 file after the snapshot 2020-04-02T23:48:40.500 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/31 file after the snapshot 2020-04-02T23:48:40.501 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/32 file after the snapshot 2020-04-02T23:48:40.503 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/33 file after the snapshot 2020-04-02T23:48:40.505 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/34 file after the snapshot 2020-04-02T23:48:40.507 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/35 file after the snapshot 2020-04-02T23:48:40.509 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/36 file after the snapshot 2020-04-02T23:48:40.511 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/37 file after the snapshot 2020-04-02T23:48:40.513 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/38 file after the snapshot 2020-04-02T23:48:40.515 INFO:tasks.workunit.client.0.smithi082.stdout: create 119/39 file after the snapshot 2020-04-02T23:48:40.517 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/.snap/snap-subdir-test 2020-04-02T23:48:41.508 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/30 file after the snapshot 2020-04-02T23:48:41.510 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/31 file after the snapshot 2020-04-02T23:48:41.512 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/32 file after the snapshot 2020-04-02T23:48:41.514 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/33 file after the snapshot 2020-04-02T23:48:41.516 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/34 file after the snapshot 2020-04-02T23:48:41.518 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/35 file after the snapshot 2020-04-02T23:48:41.520 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/36 file after the snapshot 2020-04-02T23:48:41.522 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/37 file after the snapshot 2020-04-02T23:48:41.524 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/38 file after the snapshot 2020-04-02T23:48:41.526 INFO:tasks.workunit.client.0.smithi082.stdout: create 120/39 file after the snapshot 2020-04-02T23:48:41.529 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/.snap/snap-subdir-test 2020-04-02T23:48:41.986 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/30 file after the snapshot 2020-04-02T23:48:42.160 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/31 file after the snapshot 2020-04-02T23:48:42.161 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/32 file after the snapshot 2020-04-02T23:48:42.163 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/33 file after the snapshot 2020-04-02T23:48:42.165 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/34 file after the snapshot 2020-04-02T23:48:42.166 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/35 file after the snapshot 2020-04-02T23:48:42.168 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/36 file after the snapshot 2020-04-02T23:48:42.170 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/37 file after the snapshot 2020-04-02T23:48:42.172 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/38 file after the snapshot 2020-04-02T23:48:42.174 INFO:tasks.workunit.client.0.smithi082.stdout: create 121/39 file after the snapshot 2020-04-02T23:48:42.176 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/.snap/snap-subdir-test 2020-04-02T23:48:42.882 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/30 file after the snapshot 2020-04-02T23:48:42.883 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/31 file after the snapshot 2020-04-02T23:48:42.885 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/32 file after the snapshot 2020-04-02T23:48:42.887 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/33 file after the snapshot 2020-04-02T23:48:42.889 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/34 file after the snapshot 2020-04-02T23:48:42.892 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/35 file after the snapshot 2020-04-02T23:48:42.894 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/36 file after the snapshot 2020-04-02T23:48:42.895 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/37 file after the snapshot 2020-04-02T23:48:42.976 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/38 file after the snapshot 2020-04-02T23:48:43.081 INFO:tasks.workunit.client.0.smithi082.stdout: create 122/39 file after the snapshot 2020-04-02T23:48:43.081 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/.snap/snap-subdir-test 2020-04-02T23:48:43.311 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/30 file after the snapshot 2020-04-02T23:48:43.313 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/31 file after the snapshot 2020-04-02T23:48:43.315 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/32 file after the snapshot 2020-04-02T23:48:43.317 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/33 file after the snapshot 2020-04-02T23:48:43.318 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/34 file after the snapshot 2020-04-02T23:48:43.320 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/35 file after the snapshot 2020-04-02T23:48:43.321 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/36 file after the snapshot 2020-04-02T23:48:43.323 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/37 file after the snapshot 2020-04-02T23:48:43.325 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/38 file after the snapshot 2020-04-02T23:48:43.326 INFO:tasks.workunit.client.0.smithi082.stdout: create 123/39 file after the snapshot 2020-04-02T23:48:43.328 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/.snap/snap-subdir-test 2020-04-02T23:48:43.350 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/30 file after the snapshot 2020-04-02T23:48:43.351 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/31 file after the snapshot 2020-04-02T23:48:43.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/32 file after the snapshot 2020-04-02T23:48:43.355 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/33 file after the snapshot 2020-04-02T23:48:43.357 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/34 file after the snapshot 2020-04-02T23:48:43.359 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/35 file after the snapshot 2020-04-02T23:48:43.360 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/36 file after the snapshot 2020-04-02T23:48:43.362 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/37 file after the snapshot 2020-04-02T23:48:43.364 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/38 file after the snapshot 2020-04-02T23:48:43.365 INFO:tasks.workunit.client.0.smithi082.stdout: create 124/39 file after the snapshot 2020-04-02T23:48:43.367 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/.snap/snap-subdir-test 2020-04-02T23:48:43.389 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/30 file after the snapshot 2020-04-02T23:48:43.390 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/31 file after the snapshot 2020-04-02T23:48:43.392 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/32 file after the snapshot 2020-04-02T23:48:43.394 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/33 file after the snapshot 2020-04-02T23:48:43.395 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/34 file after the snapshot 2020-04-02T23:48:43.397 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/35 file after the snapshot 2020-04-02T23:48:43.398 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/36 file after the snapshot 2020-04-02T23:48:43.400 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/37 file after the snapshot 2020-04-02T23:48:43.402 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/38 file after the snapshot 2020-04-02T23:48:43.403 INFO:tasks.workunit.client.0.smithi082.stdout: create 125/39 file after the snapshot 2020-04-02T23:48:43.405 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/.snap/snap-subdir-test 2020-04-02T23:48:43.764 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/30 file after the snapshot 2020-04-02T23:48:43.766 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/31 file after the snapshot 2020-04-02T23:48:43.768 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/32 file after the snapshot 2020-04-02T23:48:43.770 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/33 file after the snapshot 2020-04-02T23:48:43.772 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/34 file after the snapshot 2020-04-02T23:48:43.781 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/35 file after the snapshot 2020-04-02T23:48:43.781 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/36 file after the snapshot 2020-04-02T23:48:43.781 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/37 file after the snapshot 2020-04-02T23:48:43.782 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/38 file after the snapshot 2020-04-02T23:48:43.782 INFO:tasks.workunit.client.0.smithi082.stdout: create 126/39 file after the snapshot 2020-04-02T23:48:43.782 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/.snap/snap-subdir-test 2020-04-02T23:48:43.804 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/30 file after the snapshot 2020-04-02T23:48:43.805 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/31 file after the snapshot 2020-04-02T23:48:43.807 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/32 file after the snapshot 2020-04-02T23:48:43.809 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/33 file after the snapshot 2020-04-02T23:48:43.810 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/34 file after the snapshot 2020-04-02T23:48:43.812 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/35 file after the snapshot 2020-04-02T23:48:43.813 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/36 file after the snapshot 2020-04-02T23:48:43.815 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/37 file after the snapshot 2020-04-02T23:48:43.817 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/38 file after the snapshot 2020-04-02T23:48:43.819 INFO:tasks.workunit.client.0.smithi082.stdout: create 127/39 file after the snapshot 2020-04-02T23:48:43.821 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/.snap/snap-subdir-test 2020-04-02T23:48:44.323 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/30 file after the snapshot 2020-04-02T23:48:44.325 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/31 file after the snapshot 2020-04-02T23:48:44.326 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/32 file after the snapshot 2020-04-02T23:48:44.328 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/33 file after the snapshot 2020-04-02T23:48:44.330 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/34 file after the snapshot 2020-04-02T23:48:44.332 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/35 file after the snapshot 2020-04-02T23:48:44.333 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/36 file after the snapshot 2020-04-02T23:48:44.335 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/37 file after the snapshot 2020-04-02T23:48:44.337 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/38 file after the snapshot 2020-04-02T23:48:44.338 INFO:tasks.workunit.client.0.smithi082.stdout: create 128/39 file after the snapshot 2020-04-02T23:48:44.340 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/.snap/snap-subdir-test 2020-04-02T23:48:44.411 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/30 file after the snapshot 2020-04-02T23:48:44.413 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/31 file after the snapshot 2020-04-02T23:48:44.414 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/32 file after the snapshot 2020-04-02T23:48:44.416 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/33 file after the snapshot 2020-04-02T23:48:44.417 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/34 file after the snapshot 2020-04-02T23:48:44.419 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/35 file after the snapshot 2020-04-02T23:48:44.421 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/36 file after the snapshot 2020-04-02T23:48:44.423 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/37 file after the snapshot 2020-04-02T23:48:44.425 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/38 file after the snapshot 2020-04-02T23:48:44.426 INFO:tasks.workunit.client.0.smithi082.stdout: create 129/39 file after the snapshot 2020-04-02T23:48:44.428 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/.snap/snap-subdir-test 2020-04-02T23:48:44.585 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/30 file after the snapshot 2020-04-02T23:48:44.587 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/31 file after the snapshot 2020-04-02T23:48:44.589 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/32 file after the snapshot 2020-04-02T23:48:44.590 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/33 file after the snapshot 2020-04-02T23:48:44.593 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/34 file after the snapshot 2020-04-02T23:48:44.594 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/35 file after the snapshot 2020-04-02T23:48:44.596 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/36 file after the snapshot 2020-04-02T23:48:44.598 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/37 file after the snapshot 2020-04-02T23:48:44.599 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/38 file after the snapshot 2020-04-02T23:48:44.601 INFO:tasks.workunit.client.0.smithi082.stdout: create 130/39 file after the snapshot 2020-04-02T23:48:44.603 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/.snap/snap-subdir-test 2020-04-02T23:48:44.624 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/30 file after the snapshot 2020-04-02T23:48:44.625 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/31 file after the snapshot 2020-04-02T23:48:44.627 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/32 file after the snapshot 2020-04-02T23:48:44.630 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/33 file after the snapshot 2020-04-02T23:48:44.631 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/34 file after the snapshot 2020-04-02T23:48:44.633 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/35 file after the snapshot 2020-04-02T23:48:44.634 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/36 file after the snapshot 2020-04-02T23:48:44.642 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/37 file after the snapshot 2020-04-02T23:48:44.642 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/38 file after the snapshot 2020-04-02T23:48:44.643 INFO:tasks.workunit.client.0.smithi082.stdout: create 131/39 file after the snapshot 2020-04-02T23:48:44.643 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/.snap/snap-subdir-test 2020-04-02T23:48:44.664 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/30 file after the snapshot 2020-04-02T23:48:44.665 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/31 file after the snapshot 2020-04-02T23:48:44.667 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/32 file after the snapshot 2020-04-02T23:48:44.668 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/33 file after the snapshot 2020-04-02T23:48:44.670 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/34 file after the snapshot 2020-04-02T23:48:44.672 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/35 file after the snapshot 2020-04-02T23:48:44.673 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/36 file after the snapshot 2020-04-02T23:48:44.675 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/37 file after the snapshot 2020-04-02T23:48:44.676 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/38 file after the snapshot 2020-04-02T23:48:44.678 INFO:tasks.workunit.client.0.smithi082.stdout: create 132/39 file after the snapshot 2020-04-02T23:48:44.680 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/.snap/snap-subdir-test 2020-04-02T23:48:45.481 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/30 file after the snapshot 2020-04-02T23:48:45.483 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/31 file after the snapshot 2020-04-02T23:48:45.485 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/32 file after the snapshot 2020-04-02T23:48:45.489 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/33 file after the snapshot 2020-04-02T23:48:45.491 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/34 file after the snapshot 2020-04-02T23:48:45.494 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/35 file after the snapshot 2020-04-02T23:48:45.496 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/36 file after the snapshot 2020-04-02T23:48:45.498 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/37 file after the snapshot 2020-04-02T23:48:45.500 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/38 file after the snapshot 2020-04-02T23:48:45.502 INFO:tasks.workunit.client.0.smithi082.stdout: create 133/39 file after the snapshot 2020-04-02T23:48:45.504 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/.snap/snap-subdir-test 2020-04-02T23:48:45.541 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/30 file after the snapshot 2020-04-02T23:48:45.542 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/31 file after the snapshot 2020-04-02T23:48:45.544 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/32 file after the snapshot 2020-04-02T23:48:45.546 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/33 file after the snapshot 2020-04-02T23:48:45.549 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/34 file after the snapshot 2020-04-02T23:48:45.550 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/35 file after the snapshot 2020-04-02T23:48:45.555 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/36 file after the snapshot 2020-04-02T23:48:45.555 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/37 file after the snapshot 2020-04-02T23:48:45.557 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/38 file after the snapshot 2020-04-02T23:48:45.558 INFO:tasks.workunit.client.0.smithi082.stdout: create 134/39 file after the snapshot 2020-04-02T23:48:45.560 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/.snap/snap-subdir-test 2020-04-02T23:48:45.582 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/30 file after the snapshot 2020-04-02T23:48:45.583 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/31 file after the snapshot 2020-04-02T23:48:45.585 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/32 file after the snapshot 2020-04-02T23:48:45.586 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/33 file after the snapshot 2020-04-02T23:48:45.588 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/34 file after the snapshot 2020-04-02T23:48:45.590 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/35 file after the snapshot 2020-04-02T23:48:45.592 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/36 file after the snapshot 2020-04-02T23:48:45.594 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/37 file after the snapshot 2020-04-02T23:48:45.596 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/38 file after the snapshot 2020-04-02T23:48:45.598 INFO:tasks.workunit.client.0.smithi082.stdout: create 135/39 file after the snapshot 2020-04-02T23:48:45.600 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/.snap/snap-subdir-test 2020-04-02T23:48:45.621 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/30 file after the snapshot 2020-04-02T23:48:45.622 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/31 file after the snapshot 2020-04-02T23:48:45.624 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/32 file after the snapshot 2020-04-02T23:48:45.626 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/33 file after the snapshot 2020-04-02T23:48:45.628 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/34 file after the snapshot 2020-04-02T23:48:45.630 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/35 file after the snapshot 2020-04-02T23:48:45.632 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/36 file after the snapshot 2020-04-02T23:48:45.634 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/37 file after the snapshot 2020-04-02T23:48:45.635 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/38 file after the snapshot 2020-04-02T23:48:45.637 INFO:tasks.workunit.client.0.smithi082.stdout: create 136/39 file after the snapshot 2020-04-02T23:48:45.639 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/.snap/snap-subdir-test 2020-04-02T23:48:45.660 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/30 file after the snapshot 2020-04-02T23:48:45.662 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/31 file after the snapshot 2020-04-02T23:48:45.664 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/32 file after the snapshot 2020-04-02T23:48:45.666 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/33 file after the snapshot 2020-04-02T23:48:45.667 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/34 file after the snapshot 2020-04-02T23:48:45.669 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/35 file after the snapshot 2020-04-02T23:48:45.670 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/36 file after the snapshot 2020-04-02T23:48:45.672 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/37 file after the snapshot 2020-04-02T23:48:45.673 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/38 file after the snapshot 2020-04-02T23:48:45.675 INFO:tasks.workunit.client.0.smithi082.stdout: create 137/39 file after the snapshot 2020-04-02T23:48:45.677 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/.snap/snap-subdir-test 2020-04-02T23:48:46.413 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/30 file after the snapshot 2020-04-02T23:48:46.415 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/31 file after the snapshot 2020-04-02T23:48:46.417 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/32 file after the snapshot 2020-04-02T23:48:46.419 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/33 file after the snapshot 2020-04-02T23:48:46.422 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/34 file after the snapshot 2020-04-02T23:48:46.424 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/35 file after the snapshot 2020-04-02T23:48:46.426 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/36 file after the snapshot 2020-04-02T23:48:46.428 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/37 file after the snapshot 2020-04-02T23:48:46.431 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/38 file after the snapshot 2020-04-02T23:48:46.437 INFO:tasks.workunit.client.0.smithi082.stdout: create 138/39 file after the snapshot 2020-04-02T23:48:46.437 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/.snap/snap-subdir-test 2020-04-02T23:48:46.464 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/30 file after the snapshot 2020-04-02T23:48:46.466 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/31 file after the snapshot 2020-04-02T23:48:46.467 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/32 file after the snapshot 2020-04-02T23:48:46.470 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/33 file after the snapshot 2020-04-02T23:48:46.472 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/34 file after the snapshot 2020-04-02T23:48:46.474 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/35 file after the snapshot 2020-04-02T23:48:46.476 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/36 file after the snapshot 2020-04-02T23:48:46.478 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/37 file after the snapshot 2020-04-02T23:48:46.480 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/38 file after the snapshot 2020-04-02T23:48:46.482 INFO:tasks.workunit.client.0.smithi082.stdout: create 139/39 file after the snapshot 2020-04-02T23:48:46.483 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/.snap/snap-subdir-test 2020-04-02T23:48:46.513 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/30 file after the snapshot 2020-04-02T23:48:46.514 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/31 file after the snapshot 2020-04-02T23:48:46.516 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/32 file after the snapshot 2020-04-02T23:48:46.517 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/33 file after the snapshot 2020-04-02T23:48:46.519 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/34 file after the snapshot 2020-04-02T23:48:46.521 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/35 file after the snapshot 2020-04-02T23:48:46.522 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/36 file after the snapshot 2020-04-02T23:48:46.524 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/37 file after the snapshot 2020-04-02T23:48:46.526 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/38 file after the snapshot 2020-04-02T23:48:46.527 INFO:tasks.workunit.client.0.smithi082.stdout: create 140/39 file after the snapshot 2020-04-02T23:48:46.529 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/.snap/snap-subdir-test 2020-04-02T23:48:46.552 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/30 file after the snapshot 2020-04-02T23:48:46.553 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/31 file after the snapshot 2020-04-02T23:48:46.555 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/32 file after the snapshot 2020-04-02T23:48:46.557 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/33 file after the snapshot 2020-04-02T23:48:46.559 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/34 file after the snapshot 2020-04-02T23:48:46.560 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/35 file after the snapshot 2020-04-02T23:48:46.562 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/36 file after the snapshot 2020-04-02T23:48:46.564 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/37 file after the snapshot 2020-04-02T23:48:46.566 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/38 file after the snapshot 2020-04-02T23:48:46.567 INFO:tasks.workunit.client.0.smithi082.stdout: create 141/39 file after the snapshot 2020-04-02T23:48:46.569 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/.snap/snap-subdir-test 2020-04-02T23:48:46.591 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/30 file after the snapshot 2020-04-02T23:48:46.592 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/31 file after the snapshot 2020-04-02T23:48:46.594 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/32 file after the snapshot 2020-04-02T23:48:46.596 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/33 file after the snapshot 2020-04-02T23:48:46.600 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/34 file after the snapshot 2020-04-02T23:48:46.600 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/35 file after the snapshot 2020-04-02T23:48:46.602 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/36 file after the snapshot 2020-04-02T23:48:46.605 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/37 file after the snapshot 2020-04-02T23:48:46.606 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/38 file after the snapshot 2020-04-02T23:48:46.608 INFO:tasks.workunit.client.0.smithi082.stdout: create 142/39 file after the snapshot 2020-04-02T23:48:46.610 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/.snap/snap-subdir-test 2020-04-02T23:48:46.629 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/30 file after the snapshot 2020-04-02T23:48:46.630 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/31 file after the snapshot 2020-04-02T23:48:46.633 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/32 file after the snapshot 2020-04-02T23:48:46.633 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/33 file after the snapshot 2020-04-02T23:48:46.635 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/34 file after the snapshot 2020-04-02T23:48:46.637 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/35 file after the snapshot 2020-04-02T23:48:46.639 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/36 file after the snapshot 2020-04-02T23:48:46.640 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/37 file after the snapshot 2020-04-02T23:48:46.642 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/38 file after the snapshot 2020-04-02T23:48:46.644 INFO:tasks.workunit.client.0.smithi082.stdout: create 143/39 file after the snapshot 2020-04-02T23:48:46.646 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/.snap/snap-subdir-test 2020-04-02T23:48:46.666 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/30 file after the snapshot 2020-04-02T23:48:46.668 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/31 file after the snapshot 2020-04-02T23:48:46.670 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/32 file after the snapshot 2020-04-02T23:48:46.672 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/33 file after the snapshot 2020-04-02T23:48:46.673 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/34 file after the snapshot 2020-04-02T23:48:46.675 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/35 file after the snapshot 2020-04-02T23:48:46.676 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/36 file after the snapshot 2020-04-02T23:48:46.678 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/37 file after the snapshot 2020-04-02T23:48:46.680 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/38 file after the snapshot 2020-04-02T23:48:46.682 INFO:tasks.workunit.client.0.smithi082.stdout: create 144/39 file after the snapshot 2020-04-02T23:48:46.683 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/.snap/snap-subdir-test 2020-04-02T23:48:46.704 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/30 file after the snapshot 2020-04-02T23:48:46.706 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/31 file after the snapshot 2020-04-02T23:48:46.707 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/32 file after the snapshot 2020-04-02T23:48:46.709 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/33 file after the snapshot 2020-04-02T23:48:46.711 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/34 file after the snapshot 2020-04-02T23:48:46.712 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/35 file after the snapshot 2020-04-02T23:48:46.714 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/36 file after the snapshot 2020-04-02T23:48:46.716 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/37 file after the snapshot 2020-04-02T23:48:46.717 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/38 file after the snapshot 2020-04-02T23:48:46.720 INFO:tasks.workunit.client.0.smithi082.stdout: create 145/39 file after the snapshot 2020-04-02T23:48:46.722 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/.snap/snap-subdir-test 2020-04-02T23:48:47.564 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/30 file after the snapshot 2020-04-02T23:48:47.566 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/31 file after the snapshot 2020-04-02T23:48:47.568 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/32 file after the snapshot 2020-04-02T23:48:47.570 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/33 file after the snapshot 2020-04-02T23:48:47.573 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/34 file after the snapshot 2020-04-02T23:48:47.576 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/35 file after the snapshot 2020-04-02T23:48:47.578 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/36 file after the snapshot 2020-04-02T23:48:47.580 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/37 file after the snapshot 2020-04-02T23:48:47.583 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/38 file after the snapshot 2020-04-02T23:48:47.584 INFO:tasks.workunit.client.0.smithi082.stdout: create 146/39 file after the snapshot 2020-04-02T23:48:47.587 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/.snap/snap-subdir-test 2020-04-02T23:48:47.613 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/30 file after the snapshot 2020-04-02T23:48:47.615 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/31 file after the snapshot 2020-04-02T23:48:47.618 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/32 file after the snapshot 2020-04-02T23:48:47.619 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/33 file after the snapshot 2020-04-02T23:48:47.621 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/34 file after the snapshot 2020-04-02T23:48:47.623 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/35 file after the snapshot 2020-04-02T23:48:47.625 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/36 file after the snapshot 2020-04-02T23:48:47.627 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/37 file after the snapshot 2020-04-02T23:48:47.628 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/38 file after the snapshot 2020-04-02T23:48:47.630 INFO:tasks.workunit.client.0.smithi082.stdout: create 147/39 file after the snapshot 2020-04-02T23:48:47.632 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/.snap/snap-subdir-test 2020-04-02T23:48:47.654 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/30 file after the snapshot 2020-04-02T23:48:47.655 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/31 file after the snapshot 2020-04-02T23:48:47.657 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/32 file after the snapshot 2020-04-02T23:48:47.659 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/33 file after the snapshot 2020-04-02T23:48:47.661 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/34 file after the snapshot 2020-04-02T23:48:47.664 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/35 file after the snapshot 2020-04-02T23:48:47.666 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/36 file after the snapshot 2020-04-02T23:48:47.668 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/37 file after the snapshot 2020-04-02T23:48:47.670 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/38 file after the snapshot 2020-04-02T23:48:47.672 INFO:tasks.workunit.client.0.smithi082.stdout: create 148/39 file after the snapshot 2020-04-02T23:48:47.674 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/.snap/snap-subdir-test 2020-04-02T23:48:47.695 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/30 file after the snapshot 2020-04-02T23:48:47.696 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/31 file after the snapshot 2020-04-02T23:48:47.698 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/32 file after the snapshot 2020-04-02T23:48:47.700 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/33 file after the snapshot 2020-04-02T23:48:47.701 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/34 file after the snapshot 2020-04-02T23:48:47.703 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/35 file after the snapshot 2020-04-02T23:48:47.705 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/36 file after the snapshot 2020-04-02T23:48:47.707 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/37 file after the snapshot 2020-04-02T23:48:47.709 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/38 file after the snapshot 2020-04-02T23:48:47.711 INFO:tasks.workunit.client.0.smithi082.stdout: create 149/39 file after the snapshot 2020-04-02T23:48:47.713 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/.snap/snap-subdir-test 2020-04-02T23:48:47.733 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/30 file after the snapshot 2020-04-02T23:48:47.735 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/31 file after the snapshot 2020-04-02T23:48:47.737 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/32 file after the snapshot 2020-04-02T23:48:47.739 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/33 file after the snapshot 2020-04-02T23:48:47.740 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/34 file after the snapshot 2020-04-02T23:48:47.742 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/35 file after the snapshot 2020-04-02T23:48:47.744 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/36 file after the snapshot 2020-04-02T23:48:47.746 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/37 file after the snapshot 2020-04-02T23:48:47.748 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/38 file after the snapshot 2020-04-02T23:48:47.749 INFO:tasks.workunit.client.0.smithi082.stdout: create 150/39 file after the snapshot 2020-04-02T23:48:47.751 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/.snap/snap-subdir-test 2020-04-02T23:48:47.772 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/30 file after the snapshot 2020-04-02T23:48:47.774 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/31 file after the snapshot 2020-04-02T23:48:47.776 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/32 file after the snapshot 2020-04-02T23:48:47.778 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/33 file after the snapshot 2020-04-02T23:48:47.780 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/34 file after the snapshot 2020-04-02T23:48:47.781 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/35 file after the snapshot 2020-04-02T23:48:47.783 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/36 file after the snapshot 2020-04-02T23:48:47.785 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/37 file after the snapshot 2020-04-02T23:48:47.787 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/38 file after the snapshot 2020-04-02T23:48:47.789 INFO:tasks.workunit.client.0.smithi082.stdout: create 151/39 file after the snapshot 2020-04-02T23:48:47.791 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/.snap/snap-subdir-test 2020-04-02T23:48:47.969 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/30 file after the snapshot 2020-04-02T23:48:48.538 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/31 file after the snapshot 2020-04-02T23:48:48.540 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/32 file after the snapshot 2020-04-02T23:48:48.543 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/33 file after the snapshot 2020-04-02T23:48:48.544 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/34 file after the snapshot 2020-04-02T23:48:48.547 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/35 file after the snapshot 2020-04-02T23:48:48.549 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/36 file after the snapshot 2020-04-02T23:48:48.554 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/37 file after the snapshot 2020-04-02T23:48:48.555 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/38 file after the snapshot 2020-04-02T23:48:48.557 INFO:tasks.workunit.client.0.smithi082.stdout: create 152/39 file after the snapshot 2020-04-02T23:48:48.559 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/.snap/snap-subdir-test 2020-04-02T23:48:48.586 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/30 file after the snapshot 2020-04-02T23:48:48.588 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/31 file after the snapshot 2020-04-02T23:48:48.590 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/32 file after the snapshot 2020-04-02T23:48:48.592 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/33 file after the snapshot 2020-04-02T23:48:48.595 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/34 file after the snapshot 2020-04-02T23:48:48.597 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/35 file after the snapshot 2020-04-02T23:48:48.599 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/36 file after the snapshot 2020-04-02T23:48:48.600 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/37 file after the snapshot 2020-04-02T23:48:48.602 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/38 file after the snapshot 2020-04-02T23:48:48.604 INFO:tasks.workunit.client.0.smithi082.stdout: create 153/39 file after the snapshot 2020-04-02T23:48:48.972 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/.snap/snap-subdir-test 2020-04-02T23:48:49.860 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/30 file after the snapshot 2020-04-02T23:48:49.862 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/31 file after the snapshot 2020-04-02T23:48:49.865 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/32 file after the snapshot 2020-04-02T23:48:49.867 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/33 file after the snapshot 2020-04-02T23:48:49.869 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/34 file after the snapshot 2020-04-02T23:48:49.872 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/35 file after the snapshot 2020-04-02T23:48:49.873 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/36 file after the snapshot 2020-04-02T23:48:49.875 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/37 file after the snapshot 2020-04-02T23:48:49.877 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/38 file after the snapshot 2020-04-02T23:48:49.879 INFO:tasks.workunit.client.0.smithi082.stdout: create 154/39 file after the snapshot 2020-04-02T23:48:49.881 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/.snap/snap-subdir-test 2020-04-02T23:48:49.903 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/30 file after the snapshot 2020-04-02T23:48:49.905 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/31 file after the snapshot 2020-04-02T23:48:49.907 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/32 file after the snapshot 2020-04-02T23:48:49.909 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/33 file after the snapshot 2020-04-02T23:48:49.911 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/34 file after the snapshot 2020-04-02T23:48:49.913 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/35 file after the snapshot 2020-04-02T23:48:49.914 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/36 file after the snapshot 2020-04-02T23:48:49.916 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/37 file after the snapshot 2020-04-02T23:48:49.918 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/38 file after the snapshot 2020-04-02T23:48:49.921 INFO:tasks.workunit.client.0.smithi082.stdout: create 155/39 file after the snapshot 2020-04-02T23:48:49.924 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/.snap/snap-subdir-test 2020-04-02T23:48:50.017 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/30 file after the snapshot 2020-04-02T23:48:50.018 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/31 file after the snapshot 2020-04-02T23:48:50.020 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/32 file after the snapshot 2020-04-02T23:48:50.023 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/33 file after the snapshot 2020-04-02T23:48:50.024 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/34 file after the snapshot 2020-04-02T23:48:50.026 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/35 file after the snapshot 2020-04-02T23:48:50.028 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/36 file after the snapshot 2020-04-02T23:48:50.030 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/37 file after the snapshot 2020-04-02T23:48:50.032 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/38 file after the snapshot 2020-04-02T23:48:50.035 INFO:tasks.workunit.client.0.smithi082.stdout: create 156/39 file after the snapshot 2020-04-02T23:48:50.036 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/.snap/snap-subdir-test 2020-04-02T23:48:50.068 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/30 file after the snapshot 2020-04-02T23:48:50.069 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/31 file after the snapshot 2020-04-02T23:48:50.071 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/32 file after the snapshot 2020-04-02T23:48:50.073 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/33 file after the snapshot 2020-04-02T23:48:50.074 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/34 file after the snapshot 2020-04-02T23:48:50.076 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/35 file after the snapshot 2020-04-02T23:48:50.078 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/36 file after the snapshot 2020-04-02T23:48:50.080 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/37 file after the snapshot 2020-04-02T23:48:50.082 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/38 file after the snapshot 2020-04-02T23:48:50.084 INFO:tasks.workunit.client.0.smithi082.stdout: create 157/39 file after the snapshot 2020-04-02T23:48:50.086 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/.snap/snap-subdir-test 2020-04-02T23:48:50.106 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/30 file after the snapshot 2020-04-02T23:48:50.108 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/31 file after the snapshot 2020-04-02T23:48:50.110 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/32 file after the snapshot 2020-04-02T23:48:50.112 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/33 file after the snapshot 2020-04-02T23:48:50.114 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/34 file after the snapshot 2020-04-02T23:48:50.116 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/35 file after the snapshot 2020-04-02T23:48:50.117 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/36 file after the snapshot 2020-04-02T23:48:50.119 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/37 file after the snapshot 2020-04-02T23:48:50.121 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/38 file after the snapshot 2020-04-02T23:48:50.123 INFO:tasks.workunit.client.0.smithi082.stdout: create 158/39 file after the snapshot 2020-04-02T23:48:50.125 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/.snap/snap-subdir-test 2020-04-02T23:48:50.145 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/30 file after the snapshot 2020-04-02T23:48:50.146 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/31 file after the snapshot 2020-04-02T23:48:50.148 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/32 file after the snapshot 2020-04-02T23:48:50.150 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/33 file after the snapshot 2020-04-02T23:48:50.151 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/34 file after the snapshot 2020-04-02T23:48:50.154 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/35 file after the snapshot 2020-04-02T23:48:50.156 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/36 file after the snapshot 2020-04-02T23:48:50.158 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/37 file after the snapshot 2020-04-02T23:48:50.159 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/38 file after the snapshot 2020-04-02T23:48:50.162 INFO:tasks.workunit.client.0.smithi082.stdout: create 159/39 file after the snapshot 2020-04-02T23:48:50.163 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/.snap/snap-subdir-test 2020-04-02T23:48:50.184 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/30 file after the snapshot 2020-04-02T23:48:50.185 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/31 file after the snapshot 2020-04-02T23:48:50.186 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/32 file after the snapshot 2020-04-02T23:48:50.189 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/33 file after the snapshot 2020-04-02T23:48:50.190 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/34 file after the snapshot 2020-04-02T23:48:50.198 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/35 file after the snapshot 2020-04-02T23:48:50.198 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/36 file after the snapshot 2020-04-02T23:48:50.199 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/37 file after the snapshot 2020-04-02T23:48:50.199 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/38 file after the snapshot 2020-04-02T23:48:50.199 INFO:tasks.workunit.client.0.smithi082.stdout: create 160/39 file after the snapshot 2020-04-02T23:48:50.201 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/.snap/snap-subdir-test 2020-04-02T23:48:50.221 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/30 file after the snapshot 2020-04-02T23:48:50.222 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/31 file after the snapshot 2020-04-02T23:48:50.224 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/32 file after the snapshot 2020-04-02T23:48:50.227 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/33 file after the snapshot 2020-04-02T23:48:50.228 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/34 file after the snapshot 2020-04-02T23:48:50.230 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/35 file after the snapshot 2020-04-02T23:48:50.232 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/36 file after the snapshot 2020-04-02T23:48:50.234 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/37 file after the snapshot 2020-04-02T23:48:50.235 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/38 file after the snapshot 2020-04-02T23:48:50.237 INFO:tasks.workunit.client.0.smithi082.stdout: create 161/39 file after the snapshot 2020-04-02T23:48:50.241 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/.snap/snap-subdir-test 2020-04-02T23:48:50.260 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/30 file after the snapshot 2020-04-02T23:48:50.262 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/31 file after the snapshot 2020-04-02T23:48:50.264 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/32 file after the snapshot 2020-04-02T23:48:50.265 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/33 file after the snapshot 2020-04-02T23:48:50.267 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/34 file after the snapshot 2020-04-02T23:48:50.269 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/35 file after the snapshot 2020-04-02T23:48:50.270 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/36 file after the snapshot 2020-04-02T23:48:50.272 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/37 file after the snapshot 2020-04-02T23:48:50.273 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/38 file after the snapshot 2020-04-02T23:48:50.276 INFO:tasks.workunit.client.0.smithi082.stdout: create 162/39 file after the snapshot 2020-04-02T23:48:50.278 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/.snap/snap-subdir-test 2020-04-02T23:48:50.298 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/30 file after the snapshot 2020-04-02T23:48:50.300 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/31 file after the snapshot 2020-04-02T23:48:50.301 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/32 file after the snapshot 2020-04-02T23:48:50.303 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/33 file after the snapshot 2020-04-02T23:48:50.305 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/34 file after the snapshot 2020-04-02T23:48:50.307 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/35 file after the snapshot 2020-04-02T23:48:50.308 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/36 file after the snapshot 2020-04-02T23:48:50.310 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/37 file after the snapshot 2020-04-02T23:48:50.312 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/38 file after the snapshot 2020-04-02T23:48:50.314 INFO:tasks.workunit.client.0.smithi082.stdout: create 163/39 file after the snapshot 2020-04-02T23:48:50.315 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/.snap/snap-subdir-test 2020-04-02T23:48:50.335 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/30 file after the snapshot 2020-04-02T23:48:50.337 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/31 file after the snapshot 2020-04-02T23:48:50.341 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/32 file after the snapshot 2020-04-02T23:48:50.341 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/33 file after the snapshot 2020-04-02T23:48:50.342 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/34 file after the snapshot 2020-04-02T23:48:50.344 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/35 file after the snapshot 2020-04-02T23:48:50.345 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/36 file after the snapshot 2020-04-02T23:48:50.347 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/37 file after the snapshot 2020-04-02T23:48:50.349 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/38 file after the snapshot 2020-04-02T23:48:50.351 INFO:tasks.workunit.client.0.smithi082.stdout: create 164/39 file after the snapshot 2020-04-02T23:48:50.353 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/.snap/snap-subdir-test 2020-04-02T23:48:50.379 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/30 file after the snapshot 2020-04-02T23:48:50.381 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/31 file after the snapshot 2020-04-02T23:48:50.412 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/32 file after the snapshot 2020-04-02T23:48:50.412 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/33 file after the snapshot 2020-04-02T23:48:50.413 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/34 file after the snapshot 2020-04-02T23:48:50.413 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/35 file after the snapshot 2020-04-02T23:48:50.414 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/36 file after the snapshot 2020-04-02T23:48:50.417 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/37 file after the snapshot 2020-04-02T23:48:50.418 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/38 file after the snapshot 2020-04-02T23:48:50.419 INFO:tasks.workunit.client.0.smithi082.stdout: create 165/39 file after the snapshot 2020-04-02T23:48:50.421 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/.snap/snap-subdir-test 2020-04-02T23:48:50.443 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/30 file after the snapshot 2020-04-02T23:48:50.444 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/31 file after the snapshot 2020-04-02T23:48:50.448 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/32 file after the snapshot 2020-04-02T23:48:50.449 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/33 file after the snapshot 2020-04-02T23:48:50.450 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/34 file after the snapshot 2020-04-02T23:48:50.451 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/35 file after the snapshot 2020-04-02T23:48:50.453 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/36 file after the snapshot 2020-04-02T23:48:50.455 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/37 file after the snapshot 2020-04-02T23:48:50.457 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/38 file after the snapshot 2020-04-02T23:48:50.459 INFO:tasks.workunit.client.0.smithi082.stdout: create 166/39 file after the snapshot 2020-04-02T23:48:50.460 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/.snap/snap-subdir-test 2020-04-02T23:48:50.972 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/30 file after the snapshot 2020-04-02T23:48:50.993 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/31 file after the snapshot 2020-04-02T23:48:50.993 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/32 file after the snapshot 2020-04-02T23:48:50.995 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/33 file after the snapshot 2020-04-02T23:48:50.996 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/34 file after the snapshot 2020-04-02T23:48:50.998 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/35 file after the snapshot 2020-04-02T23:48:51.000 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/36 file after the snapshot 2020-04-02T23:48:51.003 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/37 file after the snapshot 2020-04-02T23:48:51.005 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/38 file after the snapshot 2020-04-02T23:48:51.006 INFO:tasks.workunit.client.0.smithi082.stdout: create 167/39 file after the snapshot 2020-04-02T23:48:51.009 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/.snap/snap-subdir-test 2020-04-02T23:48:51.040 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/30 file after the snapshot 2020-04-02T23:48:51.042 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/31 file after the snapshot 2020-04-02T23:48:51.044 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/32 file after the snapshot 2020-04-02T23:48:51.046 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/33 file after the snapshot 2020-04-02T23:48:51.047 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/34 file after the snapshot 2020-04-02T23:48:51.049 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/35 file after the snapshot 2020-04-02T23:48:51.050 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/36 file after the snapshot 2020-04-02T23:48:51.052 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/37 file after the snapshot 2020-04-02T23:48:51.054 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/38 file after the snapshot 2020-04-02T23:48:51.056 INFO:tasks.workunit.client.0.smithi082.stdout: create 168/39 file after the snapshot 2020-04-02T23:48:51.057 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/.snap/snap-subdir-test 2020-04-02T23:48:51.077 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/30 file after the snapshot 2020-04-02T23:48:51.079 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/31 file after the snapshot 2020-04-02T23:48:51.080 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/32 file after the snapshot 2020-04-02T23:48:51.082 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/33 file after the snapshot 2020-04-02T23:48:51.084 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/34 file after the snapshot 2020-04-02T23:48:51.086 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/35 file after the snapshot 2020-04-02T23:48:51.089 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/36 file after the snapshot 2020-04-02T23:48:51.090 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/37 file after the snapshot 2020-04-02T23:48:51.091 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/38 file after the snapshot 2020-04-02T23:48:51.093 INFO:tasks.workunit.client.0.smithi082.stdout: create 169/39 file after the snapshot 2020-04-02T23:48:51.095 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/.snap/snap-subdir-test 2020-04-02T23:48:51.842 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/30 file after the snapshot 2020-04-02T23:48:51.844 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/31 file after the snapshot 2020-04-02T23:48:51.846 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/32 file after the snapshot 2020-04-02T23:48:51.847 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/33 file after the snapshot 2020-04-02T23:48:51.849 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/34 file after the snapshot 2020-04-02T23:48:51.851 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/35 file after the snapshot 2020-04-02T23:48:51.853 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/36 file after the snapshot 2020-04-02T23:48:51.856 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/37 file after the snapshot 2020-04-02T23:48:51.857 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/38 file after the snapshot 2020-04-02T23:48:51.859 INFO:tasks.workunit.client.0.smithi082.stdout: create 170/39 file after the snapshot 2020-04-02T23:48:51.861 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/.snap/snap-subdir-test 2020-04-02T23:48:51.887 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/30 file after the snapshot 2020-04-02T23:48:51.889 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/31 file after the snapshot 2020-04-02T23:48:51.890 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/32 file after the snapshot 2020-04-02T23:48:51.893 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/33 file after the snapshot 2020-04-02T23:48:51.894 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/34 file after the snapshot 2020-04-02T23:48:51.896 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/35 file after the snapshot 2020-04-02T23:48:51.898 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/36 file after the snapshot 2020-04-02T23:48:51.900 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/37 file after the snapshot 2020-04-02T23:48:51.901 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/38 file after the snapshot 2020-04-02T23:48:51.903 INFO:tasks.workunit.client.0.smithi082.stdout: create 171/39 file after the snapshot 2020-04-02T23:48:51.905 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/.snap/snap-subdir-test 2020-04-02T23:48:51.926 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/30 file after the snapshot 2020-04-02T23:48:51.927 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/31 file after the snapshot 2020-04-02T23:48:51.929 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/32 file after the snapshot 2020-04-02T23:48:51.931 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/33 file after the snapshot 2020-04-02T23:48:51.933 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/34 file after the snapshot 2020-04-02T23:48:51.934 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/35 file after the snapshot 2020-04-02T23:48:51.936 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/36 file after the snapshot 2020-04-02T23:48:51.938 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/37 file after the snapshot 2020-04-02T23:48:51.940 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/38 file after the snapshot 2020-04-02T23:48:51.941 INFO:tasks.workunit.client.0.smithi082.stdout: create 172/39 file after the snapshot 2020-04-02T23:48:51.943 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/.snap/snap-subdir-test 2020-04-02T23:48:51.963 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/30 file after the snapshot 2020-04-02T23:48:51.964 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/31 file after the snapshot 2020-04-02T23:48:51.966 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/32 file after the snapshot 2020-04-02T23:48:51.971 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/33 file after the snapshot 2020-04-02T23:48:52.007 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/34 file after the snapshot 2020-04-02T23:48:52.009 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/35 file after the snapshot 2020-04-02T23:48:52.010 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/36 file after the snapshot 2020-04-02T23:48:52.011 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/37 file after the snapshot 2020-04-02T23:48:52.013 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/38 file after the snapshot 2020-04-02T23:48:52.015 INFO:tasks.workunit.client.0.smithi082.stdout: create 173/39 file after the snapshot 2020-04-02T23:48:52.018 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/.snap/snap-subdir-test 2020-04-02T23:48:52.053 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/30 file after the snapshot 2020-04-02T23:48:52.055 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/31 file after the snapshot 2020-04-02T23:48:52.056 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/32 file after the snapshot 2020-04-02T23:48:52.058 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/33 file after the snapshot 2020-04-02T23:48:52.060 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/34 file after the snapshot 2020-04-02T23:48:52.062 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/35 file after the snapshot 2020-04-02T23:48:52.064 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/36 file after the snapshot 2020-04-02T23:48:52.065 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/37 file after the snapshot 2020-04-02T23:48:52.067 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/38 file after the snapshot 2020-04-02T23:48:52.069 INFO:tasks.workunit.client.0.smithi082.stdout: create 174/39 file after the snapshot 2020-04-02T23:48:52.071 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/.snap/snap-subdir-test 2020-04-02T23:48:52.090 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/30 file after the snapshot 2020-04-02T23:48:52.091 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/31 file after the snapshot 2020-04-02T23:48:52.093 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/32 file after the snapshot 2020-04-02T23:48:52.096 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/33 file after the snapshot 2020-04-02T23:48:52.098 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/34 file after the snapshot 2020-04-02T23:48:52.100 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/35 file after the snapshot 2020-04-02T23:48:52.102 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/36 file after the snapshot 2020-04-02T23:48:52.103 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/37 file after the snapshot 2020-04-02T23:48:52.110 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/38 file after the snapshot 2020-04-02T23:48:52.110 INFO:tasks.workunit.client.0.smithi082.stdout: create 175/39 file after the snapshot 2020-04-02T23:48:52.111 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/.snap/snap-subdir-test 2020-04-02T23:48:52.129 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/30 file after the snapshot 2020-04-02T23:48:52.130 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/31 file after the snapshot 2020-04-02T23:48:52.132 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/32 file after the snapshot 2020-04-02T23:48:52.135 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/33 file after the snapshot 2020-04-02T23:48:52.136 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/34 file after the snapshot 2020-04-02T23:48:52.138 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/35 file after the snapshot 2020-04-02T23:48:52.139 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/36 file after the snapshot 2020-04-02T23:48:52.141 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/37 file after the snapshot 2020-04-02T23:48:52.143 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/38 file after the snapshot 2020-04-02T23:48:52.145 INFO:tasks.workunit.client.0.smithi082.stdout: create 176/39 file after the snapshot 2020-04-02T23:48:52.179 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/.snap/snap-subdir-test 2020-04-02T23:48:52.197 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/30 file after the snapshot 2020-04-02T23:48:52.199 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/31 file after the snapshot 2020-04-02T23:48:52.201 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/32 file after the snapshot 2020-04-02T23:48:52.204 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/33 file after the snapshot 2020-04-02T23:48:52.206 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/34 file after the snapshot 2020-04-02T23:48:52.208 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/35 file after the snapshot 2020-04-02T23:48:52.210 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/36 file after the snapshot 2020-04-02T23:48:52.211 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/37 file after the snapshot 2020-04-02T23:48:52.213 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/38 file after the snapshot 2020-04-02T23:48:52.215 INFO:tasks.workunit.client.0.smithi082.stdout: create 177/39 file after the snapshot 2020-04-02T23:48:52.216 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/.snap/snap-subdir-test 2020-04-02T23:48:52.235 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/30 file after the snapshot 2020-04-02T23:48:52.237 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/31 file after the snapshot 2020-04-02T23:48:52.238 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/32 file after the snapshot 2020-04-02T23:48:52.240 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/33 file after the snapshot 2020-04-02T23:48:52.242 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/34 file after the snapshot 2020-04-02T23:48:52.243 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/35 file after the snapshot 2020-04-02T23:48:52.245 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/36 file after the snapshot 2020-04-02T23:48:52.247 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/37 file after the snapshot 2020-04-02T23:48:52.249 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/38 file after the snapshot 2020-04-02T23:48:52.251 INFO:tasks.workunit.client.0.smithi082.stdout: create 178/39 file after the snapshot 2020-04-02T23:48:52.253 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/.snap/snap-subdir-test 2020-04-02T23:48:52.405 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/30 file after the snapshot 2020-04-02T23:48:52.406 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/31 file after the snapshot 2020-04-02T23:48:52.408 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/32 file after the snapshot 2020-04-02T23:48:52.410 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/33 file after the snapshot 2020-04-02T23:48:52.411 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/34 file after the snapshot 2020-04-02T23:48:52.414 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/35 file after the snapshot 2020-04-02T23:48:52.416 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/36 file after the snapshot 2020-04-02T23:48:52.418 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/37 file after the snapshot 2020-04-02T23:48:52.419 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/38 file after the snapshot 2020-04-02T23:48:52.421 INFO:tasks.workunit.client.0.smithi082.stdout: create 179/39 file after the snapshot 2020-04-02T23:48:52.424 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/.snap/snap-subdir-test 2020-04-02T23:48:52.443 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/30 file after the snapshot 2020-04-02T23:48:52.444 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/31 file after the snapshot 2020-04-02T23:48:52.446 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/32 file after the snapshot 2020-04-02T23:48:52.448 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/33 file after the snapshot 2020-04-02T23:48:52.450 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/34 file after the snapshot 2020-04-02T23:48:52.452 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/35 file after the snapshot 2020-04-02T23:48:52.454 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/36 file after the snapshot 2020-04-02T23:48:52.457 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/37 file after the snapshot 2020-04-02T23:48:52.458 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/38 file after the snapshot 2020-04-02T23:48:53.422 INFO:tasks.workunit.client.0.smithi082.stdout: create 180/39 file after the snapshot 2020-04-02T23:48:53.424 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/.snap/snap-subdir-test 2020-04-02T23:48:53.464 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/30 file after the snapshot 2020-04-02T23:48:53.465 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/31 file after the snapshot 2020-04-02T23:48:53.467 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/32 file after the snapshot 2020-04-02T23:48:53.469 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/33 file after the snapshot 2020-04-02T23:48:53.471 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/34 file after the snapshot 2020-04-02T23:48:53.473 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/35 file after the snapshot 2020-04-02T23:48:53.475 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/36 file after the snapshot 2020-04-02T23:48:53.477 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/37 file after the snapshot 2020-04-02T23:48:53.479 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/38 file after the snapshot 2020-04-02T23:48:53.481 INFO:tasks.workunit.client.0.smithi082.stdout: create 181/39 file after the snapshot 2020-04-02T23:48:53.484 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/.snap/snap-subdir-test 2020-04-02T23:48:53.504 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/30 file after the snapshot 2020-04-02T23:48:53.508 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/31 file after the snapshot 2020-04-02T23:48:53.509 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/32 file after the snapshot 2020-04-02T23:48:53.510 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/33 file after the snapshot 2020-04-02T23:48:53.512 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/34 file after the snapshot 2020-04-02T23:48:53.514 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/35 file after the snapshot 2020-04-02T23:48:53.516 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/36 file after the snapshot 2020-04-02T23:48:53.518 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/37 file after the snapshot 2020-04-02T23:48:53.521 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/38 file after the snapshot 2020-04-02T23:48:53.523 INFO:tasks.workunit.client.0.smithi082.stdout: create 182/39 file after the snapshot 2020-04-02T23:48:53.525 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/.snap/snap-subdir-test 2020-04-02T23:48:54.113 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/30 file after the snapshot 2020-04-02T23:48:54.114 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/31 file after the snapshot 2020-04-02T23:48:54.116 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/32 file after the snapshot 2020-04-02T23:48:54.120 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/33 file after the snapshot 2020-04-02T23:48:54.121 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/34 file after the snapshot 2020-04-02T23:48:54.122 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/35 file after the snapshot 2020-04-02T23:48:54.124 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/36 file after the snapshot 2020-04-02T23:48:54.126 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/37 file after the snapshot 2020-04-02T23:48:54.128 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/38 file after the snapshot 2020-04-02T23:48:54.131 INFO:tasks.workunit.client.0.smithi082.stdout: create 183/39 file after the snapshot 2020-04-02T23:48:54.132 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/.snap/snap-subdir-test 2020-04-02T23:48:54.160 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/30 file after the snapshot 2020-04-02T23:48:54.162 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/31 file after the snapshot 2020-04-02T23:48:54.163 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/32 file after the snapshot 2020-04-02T23:48:54.165 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/33 file after the snapshot 2020-04-02T23:48:54.167 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/34 file after the snapshot 2020-04-02T23:48:54.169 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/35 file after the snapshot 2020-04-02T23:48:54.172 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/36 file after the snapshot 2020-04-02T23:48:54.173 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/37 file after the snapshot 2020-04-02T23:48:54.175 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/38 file after the snapshot 2020-04-02T23:48:54.178 INFO:tasks.workunit.client.0.smithi082.stdout: create 184/39 file after the snapshot 2020-04-02T23:48:54.179 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/.snap/snap-subdir-test 2020-04-02T23:48:54.200 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/30 file after the snapshot 2020-04-02T23:48:54.201 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/31 file after the snapshot 2020-04-02T23:48:54.203 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/32 file after the snapshot 2020-04-02T23:48:54.205 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/33 file after the snapshot 2020-04-02T23:48:54.207 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/34 file after the snapshot 2020-04-02T23:48:54.209 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/35 file after the snapshot 2020-04-02T23:48:54.211 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/36 file after the snapshot 2020-04-02T23:48:54.325 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/37 file after the snapshot 2020-04-02T23:48:54.326 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/38 file after the snapshot 2020-04-02T23:48:55.176 INFO:tasks.workunit.client.0.smithi082.stdout: create 185/39 file after the snapshot 2020-04-02T23:48:55.178 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/.snap/snap-subdir-test 2020-04-02T23:48:55.208 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/30 file after the snapshot 2020-04-02T23:48:55.210 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/31 file after the snapshot 2020-04-02T23:48:55.213 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/32 file after the snapshot 2020-04-02T23:48:55.214 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/33 file after the snapshot 2020-04-02T23:48:55.216 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/34 file after the snapshot 2020-04-02T23:48:55.218 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/35 file after the snapshot 2020-04-02T23:48:55.220 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/36 file after the snapshot 2020-04-02T23:48:55.222 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/37 file after the snapshot 2020-04-02T23:48:55.223 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/38 file after the snapshot 2020-04-02T23:48:55.226 INFO:tasks.workunit.client.0.smithi082.stdout: create 186/39 file after the snapshot 2020-04-02T23:48:55.228 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/.snap/snap-subdir-test 2020-04-02T23:48:55.249 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/30 file after the snapshot 2020-04-02T23:48:55.251 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/31 file after the snapshot 2020-04-02T23:48:55.253 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/32 file after the snapshot 2020-04-02T23:48:55.254 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/33 file after the snapshot 2020-04-02T23:48:55.256 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/34 file after the snapshot 2020-04-02T23:48:55.258 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/35 file after the snapshot 2020-04-02T23:48:55.260 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/36 file after the snapshot 2020-04-02T23:48:55.262 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/37 file after the snapshot 2020-04-02T23:48:55.264 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/38 file after the snapshot 2020-04-02T23:48:55.269 INFO:tasks.workunit.client.0.smithi082.stdout: create 187/39 file after the snapshot 2020-04-02T23:48:55.270 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/.snap/snap-subdir-test 2020-04-02T23:48:55.289 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/30 file after the snapshot 2020-04-02T23:48:55.290 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/31 file after the snapshot 2020-04-02T23:48:55.292 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/32 file after the snapshot 2020-04-02T23:48:55.294 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/33 file after the snapshot 2020-04-02T23:48:55.295 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/34 file after the snapshot 2020-04-02T23:48:55.297 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/35 file after the snapshot 2020-04-02T23:48:55.300 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/36 file after the snapshot 2020-04-02T23:48:55.302 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/37 file after the snapshot 2020-04-02T23:48:55.304 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/38 file after the snapshot 2020-04-02T23:48:55.305 INFO:tasks.workunit.client.0.smithi082.stdout: create 188/39 file after the snapshot 2020-04-02T23:48:55.307 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/.snap/snap-subdir-test 2020-04-02T23:48:55.385 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:48:55.401 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:55.443 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:48:55.457 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:56.198 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/30 file after the snapshot 2020-04-02T23:48:56.200 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/31 file after the snapshot 2020-04-02T23:48:56.202 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/32 file after the snapshot 2020-04-02T23:48:56.204 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/33 file after the snapshot 2020-04-02T23:48:56.205 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/34 file after the snapshot 2020-04-02T23:48:56.207 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/35 file after the snapshot 2020-04-02T23:48:56.210 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/36 file after the snapshot 2020-04-02T23:48:56.212 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/37 file after the snapshot 2020-04-02T23:48:56.213 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/38 file after the snapshot 2020-04-02T23:48:56.215 INFO:tasks.workunit.client.0.smithi082.stdout: create 189/39 file after the snapshot 2020-04-02T23:48:56.218 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/.snap/snap-subdir-test 2020-04-02T23:48:56.261 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/30 file after the snapshot 2020-04-02T23:48:56.262 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/31 file after the snapshot 2020-04-02T23:48:56.264 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/32 file after the snapshot 2020-04-02T23:48:56.265 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/33 file after the snapshot 2020-04-02T23:48:56.267 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/34 file after the snapshot 2020-04-02T23:48:56.269 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/35 file after the snapshot 2020-04-02T23:48:56.271 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/36 file after the snapshot 2020-04-02T23:48:56.275 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/37 file after the snapshot 2020-04-02T23:48:56.275 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/38 file after the snapshot 2020-04-02T23:48:56.277 INFO:tasks.workunit.client.0.smithi082.stdout: create 190/39 file after the snapshot 2020-04-02T23:48:56.279 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/.snap/snap-subdir-test 2020-04-02T23:48:56.297 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/30 file after the snapshot 2020-04-02T23:48:56.299 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/31 file after the snapshot 2020-04-02T23:48:56.300 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/32 file after the snapshot 2020-04-02T23:48:56.302 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/33 file after the snapshot 2020-04-02T23:48:56.304 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/34 file after the snapshot 2020-04-02T23:48:56.306 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/35 file after the snapshot 2020-04-02T23:48:56.308 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/36 file after the snapshot 2020-04-02T23:48:56.310 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/37 file after the snapshot 2020-04-02T23:48:56.312 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/38 file after the snapshot 2020-04-02T23:48:56.314 INFO:tasks.workunit.client.0.smithi082.stdout: create 191/39 file after the snapshot 2020-04-02T23:48:56.318 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/.snap/snap-subdir-test 2020-04-02T23:48:56.339 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/30 file after the snapshot 2020-04-02T23:48:56.341 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/31 file after the snapshot 2020-04-02T23:48:56.342 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/32 file after the snapshot 2020-04-02T23:48:56.344 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/33 file after the snapshot 2020-04-02T23:48:56.345 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/34 file after the snapshot 2020-04-02T23:48:56.347 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/35 file after the snapshot 2020-04-02T23:48:56.349 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/36 file after the snapshot 2020-04-02T23:48:56.350 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/37 file after the snapshot 2020-04-02T23:48:56.352 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/38 file after the snapshot 2020-04-02T23:48:56.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 192/39 file after the snapshot 2020-04-02T23:48:56.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/.snap/snap-subdir-test 2020-04-02T23:48:56.374 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/30 file after the snapshot 2020-04-02T23:48:56.376 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/31 file after the snapshot 2020-04-02T23:48:56.377 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/32 file after the snapshot 2020-04-02T23:48:56.379 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/33 file after the snapshot 2020-04-02T23:48:56.381 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/34 file after the snapshot 2020-04-02T23:48:56.383 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/35 file after the snapshot 2020-04-02T23:48:56.385 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/36 file after the snapshot 2020-04-02T23:48:56.387 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/37 file after the snapshot 2020-04-02T23:48:56.389 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/38 file after the snapshot 2020-04-02T23:48:56.390 INFO:tasks.workunit.client.0.smithi082.stdout: create 193/39 file after the snapshot 2020-04-02T23:48:56.392 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/.snap/snap-subdir-test 2020-04-02T23:48:56.797 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/30 file after the snapshot 2020-04-02T23:48:56.798 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/31 file after the snapshot 2020-04-02T23:48:56.800 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/32 file after the snapshot 2020-04-02T23:48:56.802 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/33 file after the snapshot 2020-04-02T23:48:56.804 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/34 file after the snapshot 2020-04-02T23:48:56.807 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/35 file after the snapshot 2020-04-02T23:48:56.808 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/36 file after the snapshot 2020-04-02T23:48:56.810 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/37 file after the snapshot 2020-04-02T23:48:56.812 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/38 file after the snapshot 2020-04-02T23:48:56.813 INFO:tasks.workunit.client.0.smithi082.stdout: create 194/39 file after the snapshot 2020-04-02T23:48:56.815 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/.snap/snap-subdir-test 2020-04-02T23:48:56.834 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/30 file after the snapshot 2020-04-02T23:48:56.835 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/31 file after the snapshot 2020-04-02T23:48:56.837 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/32 file after the snapshot 2020-04-02T23:48:56.839 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/33 file after the snapshot 2020-04-02T23:48:56.841 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/34 file after the snapshot 2020-04-02T23:48:56.842 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/35 file after the snapshot 2020-04-02T23:48:56.845 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/36 file after the snapshot 2020-04-02T23:48:56.847 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/37 file after the snapshot 2020-04-02T23:48:56.848 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/38 file after the snapshot 2020-04-02T23:48:56.850 INFO:tasks.workunit.client.0.smithi082.stdout: create 195/39 file after the snapshot 2020-04-02T23:48:56.852 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/.snap/snap-subdir-test 2020-04-02T23:48:56.873 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/30 file after the snapshot 2020-04-02T23:48:56.875 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/31 file after the snapshot 2020-04-02T23:48:56.876 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/32 file after the snapshot 2020-04-02T23:48:56.878 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/33 file after the snapshot 2020-04-02T23:48:56.879 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/34 file after the snapshot 2020-04-02T23:48:56.881 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/35 file after the snapshot 2020-04-02T23:48:56.883 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/36 file after the snapshot 2020-04-02T23:48:56.884 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/37 file after the snapshot 2020-04-02T23:48:56.886 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/38 file after the snapshot 2020-04-02T23:48:56.888 INFO:tasks.workunit.client.0.smithi082.stdout: create 196/39 file after the snapshot 2020-04-02T23:48:56.889 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/.snap/snap-subdir-test 2020-04-02T23:48:57.303 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/30 file after the snapshot 2020-04-02T23:48:57.304 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/31 file after the snapshot 2020-04-02T23:48:57.306 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/32 file after the snapshot 2020-04-02T23:48:57.308 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/33 file after the snapshot 2020-04-02T23:48:57.310 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/34 file after the snapshot 2020-04-02T23:48:57.312 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/35 file after the snapshot 2020-04-02T23:48:57.314 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/36 file after the snapshot 2020-04-02T23:48:57.316 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/37 file after the snapshot 2020-04-02T23:48:57.318 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/38 file after the snapshot 2020-04-02T23:48:57.319 INFO:tasks.workunit.client.0.smithi082.stdout: create 197/39 file after the snapshot 2020-04-02T23:48:57.321 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/.snap/snap-subdir-test 2020-04-02T23:48:57.351 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/30 file after the snapshot 2020-04-02T23:48:57.353 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/31 file after the snapshot 2020-04-02T23:48:57.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/32 file after the snapshot 2020-04-02T23:48:57.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/33 file after the snapshot 2020-04-02T23:48:57.358 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/34 file after the snapshot 2020-04-02T23:48:57.360 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/35 file after the snapshot 2020-04-02T23:48:57.361 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/36 file after the snapshot 2020-04-02T23:48:57.363 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/37 file after the snapshot 2020-04-02T23:48:57.365 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/38 file after the snapshot 2020-04-02T23:48:57.367 INFO:tasks.workunit.client.0.smithi082.stdout: create 198/39 file after the snapshot 2020-04-02T23:48:57.368 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/.snap/snap-subdir-test 2020-04-02T23:48:57.387 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/30 file after the snapshot 2020-04-02T23:48:57.388 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/31 file after the snapshot 2020-04-02T23:48:57.389 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/32 file after the snapshot 2020-04-02T23:48:57.391 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/33 file after the snapshot 2020-04-02T23:48:57.393 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/34 file after the snapshot 2020-04-02T23:48:57.395 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/35 file after the snapshot 2020-04-02T23:48:57.397 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/36 file after the snapshot 2020-04-02T23:48:57.398 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/37 file after the snapshot 2020-04-02T23:48:57.400 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/38 file after the snapshot 2020-04-02T23:48:57.402 INFO:tasks.workunit.client.0.smithi082.stdout: create 199/39 file after the snapshot 2020-04-02T23:48:57.403 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/.snap/snap-subdir-test 2020-04-02T23:48:57.421 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/30 file after the snapshot 2020-04-02T23:48:57.423 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/31 file after the snapshot 2020-04-02T23:48:57.425 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/32 file after the snapshot 2020-04-02T23:48:57.427 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/33 file after the snapshot 2020-04-02T23:48:57.430 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/34 file after the snapshot 2020-04-02T23:48:57.431 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/35 file after the snapshot 2020-04-02T23:48:57.432 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/36 file after the snapshot 2020-04-02T23:48:57.434 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/37 file after the snapshot 2020-04-02T23:48:57.435 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/38 file after the snapshot 2020-04-02T23:48:57.437 INFO:tasks.workunit.client.0.smithi082.stdout: create 200/39 file after the snapshot 2020-04-02T23:48:57.438 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/.snap/snap-subdir-test 2020-04-02T23:48:57.461 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/30 file after the snapshot 2020-04-02T23:48:57.462 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/31 file after the snapshot 2020-04-02T23:48:57.464 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/32 file after the snapshot 2020-04-02T23:48:57.465 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/33 file after the snapshot 2020-04-02T23:48:57.467 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/34 file after the snapshot 2020-04-02T23:48:57.469 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/35 file after the snapshot 2020-04-02T23:48:57.471 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/36 file after the snapshot 2020-04-02T23:48:57.472 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/37 file after the snapshot 2020-04-02T23:48:57.474 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/38 file after the snapshot 2020-04-02T23:48:57.476 INFO:tasks.workunit.client.0.smithi082.stdout: create 201/39 file after the snapshot 2020-04-02T23:48:57.478 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/.snap/snap-subdir-test 2020-04-02T23:48:57.675 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/30 file after the snapshot 2020-04-02T23:48:57.676 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/31 file after the snapshot 2020-04-02T23:48:57.678 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/32 file after the snapshot 2020-04-02T23:48:57.680 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/33 file after the snapshot 2020-04-02T23:48:57.682 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/34 file after the snapshot 2020-04-02T23:48:57.683 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/35 file after the snapshot 2020-04-02T23:48:57.685 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/36 file after the snapshot 2020-04-02T23:48:57.687 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/37 file after the snapshot 2020-04-02T23:48:57.689 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/38 file after the snapshot 2020-04-02T23:48:57.691 INFO:tasks.workunit.client.0.smithi082.stdout: create 202/39 file after the snapshot 2020-04-02T23:48:57.692 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/.snap/snap-subdir-test 2020-04-02T23:48:57.712 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/30 file after the snapshot 2020-04-02T23:48:57.714 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/31 file after the snapshot 2020-04-02T23:48:57.715 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/32 file after the snapshot 2020-04-02T23:48:57.717 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/33 file after the snapshot 2020-04-02T23:48:57.719 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/34 file after the snapshot 2020-04-02T23:48:57.721 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/35 file after the snapshot 2020-04-02T23:48:57.723 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/36 file after the snapshot 2020-04-02T23:48:57.725 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/37 file after the snapshot 2020-04-02T23:48:57.727 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/38 file after the snapshot 2020-04-02T23:48:57.729 INFO:tasks.workunit.client.0.smithi082.stdout: create 203/39 file after the snapshot 2020-04-02T23:48:57.730 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/.snap/snap-subdir-test 2020-04-02T23:48:57.749 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/30 file after the snapshot 2020-04-02T23:48:57.750 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/31 file after the snapshot 2020-04-02T23:48:57.752 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/32 file after the snapshot 2020-04-02T23:48:57.753 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/33 file after the snapshot 2020-04-02T23:48:57.755 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/34 file after the snapshot 2020-04-02T23:48:57.757 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/35 file after the snapshot 2020-04-02T23:48:57.758 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/36 file after the snapshot 2020-04-02T23:48:57.761 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/37 file after the snapshot 2020-04-02T23:48:57.762 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/38 file after the snapshot 2020-04-02T23:48:57.764 INFO:tasks.workunit.client.0.smithi082.stdout: create 204/39 file after the snapshot 2020-04-02T23:48:57.766 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/.snap/snap-subdir-test 2020-04-02T23:48:58.761 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/30 file after the snapshot 2020-04-02T23:48:58.763 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/31 file after the snapshot 2020-04-02T23:48:58.765 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/32 file after the snapshot 2020-04-02T23:48:58.767 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/33 file after the snapshot 2020-04-02T23:48:58.768 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/34 file after the snapshot 2020-04-02T23:48:58.770 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/35 file after the snapshot 2020-04-02T23:48:58.772 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/36 file after the snapshot 2020-04-02T23:48:58.775 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/37 file after the snapshot 2020-04-02T23:48:58.778 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/38 file after the snapshot 2020-04-02T23:48:58.779 INFO:tasks.workunit.client.0.smithi082.stdout: create 205/39 file after the snapshot 2020-04-02T23:48:58.781 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/.snap/snap-subdir-test 2020-04-02T23:48:58.801 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/30 file after the snapshot 2020-04-02T23:48:58.803 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/31 file after the snapshot 2020-04-02T23:48:58.805 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/32 file after the snapshot 2020-04-02T23:48:58.807 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/33 file after the snapshot 2020-04-02T23:48:58.809 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/34 file after the snapshot 2020-04-02T23:48:58.811 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/35 file after the snapshot 2020-04-02T23:48:58.813 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/36 file after the snapshot 2020-04-02T23:48:58.817 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/37 file after the snapshot 2020-04-02T23:48:58.817 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/38 file after the snapshot 2020-04-02T23:48:58.821 INFO:tasks.workunit.client.0.smithi082.stdout: create 206/39 file after the snapshot 2020-04-02T23:48:58.821 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/.snap/snap-subdir-test 2020-04-02T23:48:59.236 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/30 file after the snapshot 2020-04-02T23:48:59.238 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/31 file after the snapshot 2020-04-02T23:48:59.239 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/32 file after the snapshot 2020-04-02T23:48:59.241 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/33 file after the snapshot 2020-04-02T23:48:59.243 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/34 file after the snapshot 2020-04-02T23:48:59.245 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/35 file after the snapshot 2020-04-02T23:48:59.247 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/36 file after the snapshot 2020-04-02T23:48:59.249 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/37 file after the snapshot 2020-04-02T23:48:59.252 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/38 file after the snapshot 2020-04-02T23:48:59.254 INFO:tasks.workunit.client.0.smithi082.stdout: create 207/39 file after the snapshot 2020-04-02T23:48:59.256 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/.snap/snap-subdir-test 2020-04-02T23:48:59.281 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/30 file after the snapshot 2020-04-02T23:48:59.282 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/31 file after the snapshot 2020-04-02T23:48:59.284 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/32 file after the snapshot 2020-04-02T23:48:59.286 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/33 file after the snapshot 2020-04-02T23:48:59.287 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/34 file after the snapshot 2020-04-02T23:48:59.290 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/35 file after the snapshot 2020-04-02T23:48:59.292 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/36 file after the snapshot 2020-04-02T23:48:59.294 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/37 file after the snapshot 2020-04-02T23:48:59.305 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/38 file after the snapshot 2020-04-02T23:48:59.305 INFO:tasks.workunit.client.0.smithi082.stdout: create 208/39 file after the snapshot 2020-04-02T23:48:59.305 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/.snap/snap-subdir-test 2020-04-02T23:48:59.318 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/30 file after the snapshot 2020-04-02T23:48:59.320 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/31 file after the snapshot 2020-04-02T23:48:59.322 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/32 file after the snapshot 2020-04-02T23:48:59.325 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/33 file after the snapshot 2020-04-02T23:48:59.326 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/34 file after the snapshot 2020-04-02T23:48:59.328 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/35 file after the snapshot 2020-04-02T23:48:59.330 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/36 file after the snapshot 2020-04-02T23:48:59.332 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/37 file after the snapshot 2020-04-02T23:48:59.334 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/38 file after the snapshot 2020-04-02T23:48:59.336 INFO:tasks.workunit.client.0.smithi082.stdout: create 209/39 file after the snapshot 2020-04-02T23:48:59.338 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/.snap/snap-subdir-test 2020-04-02T23:48:59.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/30 file after the snapshot 2020-04-02T23:48:59.357 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/31 file after the snapshot 2020-04-02T23:48:59.359 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/32 file after the snapshot 2020-04-02T23:48:59.360 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/33 file after the snapshot 2020-04-02T23:48:59.363 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/34 file after the snapshot 2020-04-02T23:48:59.364 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/35 file after the snapshot 2020-04-02T23:48:59.365 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/36 file after the snapshot 2020-04-02T23:48:59.366 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/37 file after the snapshot 2020-04-02T23:48:59.368 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/38 file after the snapshot 2020-04-02T23:48:59.370 INFO:tasks.workunit.client.0.smithi082.stdout: create 210/39 file after the snapshot 2020-04-02T23:48:59.372 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/.snap/snap-subdir-test 2020-04-02T23:48:59.390 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/30 file after the snapshot 2020-04-02T23:48:59.392 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/31 file after the snapshot 2020-04-02T23:48:59.393 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/32 file after the snapshot 2020-04-02T23:48:59.395 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/33 file after the snapshot 2020-04-02T23:48:59.397 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/34 file after the snapshot 2020-04-02T23:48:59.398 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/35 file after the snapshot 2020-04-02T23:48:59.400 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/36 file after the snapshot 2020-04-02T23:48:59.401 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/37 file after the snapshot 2020-04-02T23:48:59.403 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/38 file after the snapshot 2020-04-02T23:48:59.404 INFO:tasks.workunit.client.0.smithi082.stdout: create 211/39 file after the snapshot 2020-04-02T23:48:59.406 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/.snap/snap-subdir-test 2020-04-02T23:48:59.428 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/30 file after the snapshot 2020-04-02T23:48:59.429 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/31 file after the snapshot 2020-04-02T23:48:59.431 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/32 file after the snapshot 2020-04-02T23:48:59.433 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/33 file after the snapshot 2020-04-02T23:48:59.435 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/34 file after the snapshot 2020-04-02T23:48:59.437 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/35 file after the snapshot 2020-04-02T23:48:59.439 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/36 file after the snapshot 2020-04-02T23:48:59.440 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/37 file after the snapshot 2020-04-02T23:48:59.445 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/38 file after the snapshot 2020-04-02T23:48:59.446 INFO:tasks.workunit.client.0.smithi082.stdout: create 212/39 file after the snapshot 2020-04-02T23:48:59.446 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/.snap/snap-subdir-test 2020-04-02T23:48:59.463 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/30 file after the snapshot 2020-04-02T23:48:59.464 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/31 file after the snapshot 2020-04-02T23:48:59.467 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/32 file after the snapshot 2020-04-02T23:48:59.468 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/33 file after the snapshot 2020-04-02T23:48:59.470 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/34 file after the snapshot 2020-04-02T23:48:59.472 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/35 file after the snapshot 2020-04-02T23:48:59.474 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/36 file after the snapshot 2020-04-02T23:48:59.475 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/37 file after the snapshot 2020-04-02T23:48:59.477 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/38 file after the snapshot 2020-04-02T23:48:59.479 INFO:tasks.workunit.client.0.smithi082.stdout: create 213/39 file after the snapshot 2020-04-02T23:48:59.481 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/.snap/snap-subdir-test 2020-04-02T23:49:00.305 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/30 file after the snapshot 2020-04-02T23:49:00.307 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/31 file after the snapshot 2020-04-02T23:49:00.309 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/32 file after the snapshot 2020-04-02T23:49:00.310 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/33 file after the snapshot 2020-04-02T23:49:00.313 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/34 file after the snapshot 2020-04-02T23:49:00.315 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/35 file after the snapshot 2020-04-02T23:49:00.316 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/36 file after the snapshot 2020-04-02T23:49:00.318 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/37 file after the snapshot 2020-04-02T23:49:00.321 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/38 file after the snapshot 2020-04-02T23:49:00.323 INFO:tasks.workunit.client.0.smithi082.stdout: create 214/39 file after the snapshot 2020-04-02T23:49:00.325 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/.snap/snap-subdir-test 2020-04-02T23:49:00.607 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/30 file after the snapshot 2020-04-02T23:49:00.609 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/31 file after the snapshot 2020-04-02T23:49:00.610 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/32 file after the snapshot 2020-04-02T23:49:00.612 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/33 file after the snapshot 2020-04-02T23:49:00.614 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/34 file after the snapshot 2020-04-02T23:49:00.615 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/35 file after the snapshot 2020-04-02T23:49:00.617 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/36 file after the snapshot 2020-04-02T23:49:00.619 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/37 file after the snapshot 2020-04-02T23:49:00.620 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/38 file after the snapshot 2020-04-02T23:49:00.623 INFO:tasks.workunit.client.0.smithi082.stdout: create 215/39 file after the snapshot 2020-04-02T23:49:00.624 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/.snap/snap-subdir-test 2020-04-02T23:49:00.642 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/30 file after the snapshot 2020-04-02T23:49:00.644 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/31 file after the snapshot 2020-04-02T23:49:00.646 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/32 file after the snapshot 2020-04-02T23:49:00.648 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/33 file after the snapshot 2020-04-02T23:49:00.649 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/34 file after the snapshot 2020-04-02T23:49:00.651 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/35 file after the snapshot 2020-04-02T23:49:00.652 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/36 file after the snapshot 2020-04-02T23:49:00.654 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/37 file after the snapshot 2020-04-02T23:49:00.656 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/38 file after the snapshot 2020-04-02T23:49:00.658 INFO:tasks.workunit.client.0.smithi082.stdout: create 216/39 file after the snapshot 2020-04-02T23:49:00.660 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/.snap/snap-subdir-test 2020-04-02T23:49:00.677 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/30 file after the snapshot 2020-04-02T23:49:00.679 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/31 file after the snapshot 2020-04-02T23:49:00.681 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/32 file after the snapshot 2020-04-02T23:49:00.683 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/33 file after the snapshot 2020-04-02T23:49:00.685 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/34 file after the snapshot 2020-04-02T23:49:00.687 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/35 file after the snapshot 2020-04-02T23:49:00.689 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/36 file after the snapshot 2020-04-02T23:49:00.690 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/37 file after the snapshot 2020-04-02T23:49:00.692 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/38 file after the snapshot 2020-04-02T23:49:00.694 INFO:tasks.workunit.client.0.smithi082.stdout: create 217/39 file after the snapshot 2020-04-02T23:49:00.696 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/.snap/snap-subdir-test 2020-04-02T23:49:00.713 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/30 file after the snapshot 2020-04-02T23:49:00.714 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/31 file after the snapshot 2020-04-02T23:49:00.716 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/32 file after the snapshot 2020-04-02T23:49:00.718 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/33 file after the snapshot 2020-04-02T23:49:00.720 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/34 file after the snapshot 2020-04-02T23:49:00.721 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/35 file after the snapshot 2020-04-02T23:49:00.723 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/36 file after the snapshot 2020-04-02T23:49:00.725 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/37 file after the snapshot 2020-04-02T23:49:00.727 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/38 file after the snapshot 2020-04-02T23:49:00.729 INFO:tasks.workunit.client.0.smithi082.stdout: create 218/39 file after the snapshot 2020-04-02T23:49:00.730 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/.snap/snap-subdir-test 2020-04-02T23:49:00.748 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/30 file after the snapshot 2020-04-02T23:49:00.750 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/31 file after the snapshot 2020-04-02T23:49:00.751 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/32 file after the snapshot 2020-04-02T23:49:00.754 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/33 file after the snapshot 2020-04-02T23:49:00.754 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/34 file after the snapshot 2020-04-02T23:49:00.756 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/35 file after the snapshot 2020-04-02T23:49:00.758 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/36 file after the snapshot 2020-04-02T23:49:00.760 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/37 file after the snapshot 2020-04-02T23:49:00.762 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/38 file after the snapshot 2020-04-02T23:49:00.764 INFO:tasks.workunit.client.0.smithi082.stdout: create 219/39 file after the snapshot 2020-04-02T23:49:00.766 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/.snap/snap-subdir-test 2020-04-02T23:49:00.783 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/30 file after the snapshot 2020-04-02T23:49:00.785 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/31 file after the snapshot 2020-04-02T23:49:00.787 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/32 file after the snapshot 2020-04-02T23:49:00.789 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/33 file after the snapshot 2020-04-02T23:49:00.791 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/34 file after the snapshot 2020-04-02T23:49:00.794 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/35 file after the snapshot 2020-04-02T23:49:00.796 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/36 file after the snapshot 2020-04-02T23:49:00.798 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/37 file after the snapshot 2020-04-02T23:49:00.801 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/38 file after the snapshot 2020-04-02T23:49:00.801 INFO:tasks.workunit.client.0.smithi082.stdout: create 220/39 file after the snapshot 2020-04-02T23:49:00.803 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/.snap/snap-subdir-test 2020-04-02T23:49:00.820 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/30 file after the snapshot 2020-04-02T23:49:00.822 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/31 file after the snapshot 2020-04-02T23:49:00.824 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/32 file after the snapshot 2020-04-02T23:49:00.825 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/33 file after the snapshot 2020-04-02T23:49:00.827 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/34 file after the snapshot 2020-04-02T23:49:00.829 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/35 file after the snapshot 2020-04-02T23:49:00.831 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/36 file after the snapshot 2020-04-02T23:49:00.833 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/37 file after the snapshot 2020-04-02T23:49:00.835 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/38 file after the snapshot 2020-04-02T23:49:00.836 INFO:tasks.workunit.client.0.smithi082.stdout: create 221/39 file after the snapshot 2020-04-02T23:49:00.838 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/.snap/snap-subdir-test 2020-04-02T23:49:00.857 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/30 file after the snapshot 2020-04-02T23:49:00.858 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/31 file after the snapshot 2020-04-02T23:49:00.860 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/32 file after the snapshot 2020-04-02T23:49:00.862 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/33 file after the snapshot 2020-04-02T23:49:00.864 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/34 file after the snapshot 2020-04-02T23:49:00.866 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/35 file after the snapshot 2020-04-02T23:49:00.873 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/36 file after the snapshot 2020-04-02T23:49:00.873 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/37 file after the snapshot 2020-04-02T23:49:00.873 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/38 file after the snapshot 2020-04-02T23:49:00.875 INFO:tasks.workunit.client.0.smithi082.stdout: create 222/39 file after the snapshot 2020-04-02T23:49:00.876 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/.snap/snap-subdir-test 2020-04-02T23:49:01.140 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/30 file after the snapshot 2020-04-02T23:49:01.141 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/31 file after the snapshot 2020-04-02T23:49:01.143 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/32 file after the snapshot 2020-04-02T23:49:01.144 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/33 file after the snapshot 2020-04-02T23:49:01.147 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/34 file after the snapshot 2020-04-02T23:49:01.148 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/35 file after the snapshot 2020-04-02T23:49:01.151 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/36 file after the snapshot 2020-04-02T23:49:01.153 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/37 file after the snapshot 2020-04-02T23:49:01.155 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/38 file after the snapshot 2020-04-02T23:49:01.157 INFO:tasks.workunit.client.0.smithi082.stdout: create 223/39 file after the snapshot 2020-04-02T23:49:01.159 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/.snap/snap-subdir-test 2020-04-02T23:49:01.182 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/30 file after the snapshot 2020-04-02T23:49:01.184 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/31 file after the snapshot 2020-04-02T23:49:01.186 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/32 file after the snapshot 2020-04-02T23:49:01.188 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/33 file after the snapshot 2020-04-02T23:49:01.190 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/34 file after the snapshot 2020-04-02T23:49:01.192 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/35 file after the snapshot 2020-04-02T23:49:01.194 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/36 file after the snapshot 2020-04-02T23:49:01.196 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/37 file after the snapshot 2020-04-02T23:49:01.198 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/38 file after the snapshot 2020-04-02T23:49:01.199 INFO:tasks.workunit.client.0.smithi082.stdout: create 224/39 file after the snapshot 2020-04-02T23:49:01.201 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/.snap/snap-subdir-test 2020-04-02T23:49:02.120 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/30 file after the snapshot 2020-04-02T23:49:02.121 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/31 file after the snapshot 2020-04-02T23:49:02.123 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/32 file after the snapshot 2020-04-02T23:49:02.125 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/33 file after the snapshot 2020-04-02T23:49:02.127 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/34 file after the snapshot 2020-04-02T23:49:02.129 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/35 file after the snapshot 2020-04-02T23:49:02.132 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/36 file after the snapshot 2020-04-02T23:49:02.133 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/37 file after the snapshot 2020-04-02T23:49:02.135 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/38 file after the snapshot 2020-04-02T23:49:02.137 INFO:tasks.workunit.client.0.smithi082.stdout: create 225/39 file after the snapshot 2020-04-02T23:49:02.139 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/.snap/snap-subdir-test 2020-04-02T23:49:02.677 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/30 file after the snapshot 2020-04-02T23:49:02.678 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/31 file after the snapshot 2020-04-02T23:49:02.680 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/32 file after the snapshot 2020-04-02T23:49:02.682 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/33 file after the snapshot 2020-04-02T23:49:02.684 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/34 file after the snapshot 2020-04-02T23:49:02.687 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/35 file after the snapshot 2020-04-02T23:49:02.689 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/36 file after the snapshot 2020-04-02T23:49:02.690 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/37 file after the snapshot 2020-04-02T23:49:02.692 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/38 file after the snapshot 2020-04-02T23:49:02.695 INFO:tasks.workunit.client.0.smithi082.stdout: create 226/39 file after the snapshot 2020-04-02T23:49:02.697 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/.snap/snap-subdir-test 2020-04-02T23:49:02.715 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/30 file after the snapshot 2020-04-02T23:49:02.717 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/31 file after the snapshot 2020-04-02T23:49:02.719 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/32 file after the snapshot 2020-04-02T23:49:02.720 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/33 file after the snapshot 2020-04-02T23:49:02.722 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/34 file after the snapshot 2020-04-02T23:49:02.724 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/35 file after the snapshot 2020-04-02T23:49:02.726 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/36 file after the snapshot 2020-04-02T23:49:02.728 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/37 file after the snapshot 2020-04-02T23:49:02.730 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/38 file after the snapshot 2020-04-02T23:49:02.732 INFO:tasks.workunit.client.0.smithi082.stdout: create 227/39 file after the snapshot 2020-04-02T23:49:02.733 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/.snap/snap-subdir-test 2020-04-02T23:49:02.751 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/30 file after the snapshot 2020-04-02T23:49:02.754 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/31 file after the snapshot 2020-04-02T23:49:02.754 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/32 file after the snapshot 2020-04-02T23:49:02.756 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/33 file after the snapshot 2020-04-02T23:49:02.758 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/34 file after the snapshot 2020-04-02T23:49:02.760 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/35 file after the snapshot 2020-04-02T23:49:02.762 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/36 file after the snapshot 2020-04-02T23:49:02.764 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/37 file after the snapshot 2020-04-02T23:49:02.766 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/38 file after the snapshot 2020-04-02T23:49:02.768 INFO:tasks.workunit.client.0.smithi082.stdout: create 228/39 file after the snapshot 2020-04-02T23:49:02.770 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/.snap/snap-subdir-test 2020-04-02T23:49:02.787 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/30 file after the snapshot 2020-04-02T23:49:02.789 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/31 file after the snapshot 2020-04-02T23:49:02.790 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/32 file after the snapshot 2020-04-02T23:49:02.792 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/33 file after the snapshot 2020-04-02T23:49:02.794 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/34 file after the snapshot 2020-04-02T23:49:02.796 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/35 file after the snapshot 2020-04-02T23:49:02.798 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/36 file after the snapshot 2020-04-02T23:49:02.800 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/37 file after the snapshot 2020-04-02T23:49:02.802 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/38 file after the snapshot 2020-04-02T23:49:02.803 INFO:tasks.workunit.client.0.smithi082.stdout: create 229/39 file after the snapshot 2020-04-02T23:49:02.805 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/.snap/snap-subdir-test 2020-04-02T23:49:02.823 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/30 file after the snapshot 2020-04-02T23:49:02.825 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/31 file after the snapshot 2020-04-02T23:49:02.827 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/32 file after the snapshot 2020-04-02T23:49:02.828 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/33 file after the snapshot 2020-04-02T23:49:02.830 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/34 file after the snapshot 2020-04-02T23:49:02.832 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/35 file after the snapshot 2020-04-02T23:49:02.834 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/36 file after the snapshot 2020-04-02T23:49:02.837 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/37 file after the snapshot 2020-04-02T23:49:02.839 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/38 file after the snapshot 2020-04-02T23:49:02.841 INFO:tasks.workunit.client.0.smithi082.stdout: create 230/39 file after the snapshot 2020-04-02T23:49:02.842 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/.snap/snap-subdir-test 2020-04-02T23:49:02.859 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/30 file after the snapshot 2020-04-02T23:49:02.861 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/31 file after the snapshot 2020-04-02T23:49:02.862 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/32 file after the snapshot 2020-04-02T23:49:02.864 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/33 file after the snapshot 2020-04-02T23:49:02.866 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/34 file after the snapshot 2020-04-02T23:49:02.868 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/35 file after the snapshot 2020-04-02T23:49:02.870 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/36 file after the snapshot 2020-04-02T23:49:02.872 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/37 file after the snapshot 2020-04-02T23:49:02.873 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/38 file after the snapshot 2020-04-02T23:49:02.875 INFO:tasks.workunit.client.0.smithi082.stdout: create 231/39 file after the snapshot 2020-04-02T23:49:02.878 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/.snap/snap-subdir-test 2020-04-02T23:49:02.895 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/30 file after the snapshot 2020-04-02T23:49:02.899 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/31 file after the snapshot 2020-04-02T23:49:02.899 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/32 file after the snapshot 2020-04-02T23:49:02.900 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/33 file after the snapshot 2020-04-02T23:49:02.902 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/34 file after the snapshot 2020-04-02T23:49:02.904 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/35 file after the snapshot 2020-04-02T23:49:02.906 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/36 file after the snapshot 2020-04-02T23:49:02.908 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/37 file after the snapshot 2020-04-02T23:49:02.910 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/38 file after the snapshot 2020-04-02T23:49:02.911 INFO:tasks.workunit.client.0.smithi082.stdout: create 232/39 file after the snapshot 2020-04-02T23:49:02.913 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/.snap/snap-subdir-test 2020-04-02T23:49:02.930 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/30 file after the snapshot 2020-04-02T23:49:02.931 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/31 file after the snapshot 2020-04-02T23:49:02.933 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/32 file after the snapshot 2020-04-02T23:49:02.934 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/33 file after the snapshot 2020-04-02T23:49:02.936 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/34 file after the snapshot 2020-04-02T23:49:02.938 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/35 file after the snapshot 2020-04-02T23:49:02.940 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/36 file after the snapshot 2020-04-02T23:49:02.942 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/37 file after the snapshot 2020-04-02T23:49:02.944 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/38 file after the snapshot 2020-04-02T23:49:02.945 INFO:tasks.workunit.client.0.smithi082.stdout: create 233/39 file after the snapshot 2020-04-02T23:49:02.947 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/.snap/snap-subdir-test 2020-04-02T23:49:02.963 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/30 file after the snapshot 2020-04-02T23:49:02.965 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/31 file after the snapshot 2020-04-02T23:49:02.967 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/32 file after the snapshot 2020-04-02T23:49:02.972 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/33 file after the snapshot 2020-04-02T23:49:03.015 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/34 file after the snapshot 2020-04-02T23:49:03.017 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/35 file after the snapshot 2020-04-02T23:49:03.020 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/36 file after the snapshot 2020-04-02T23:49:03.022 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/37 file after the snapshot 2020-04-02T23:49:03.024 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/38 file after the snapshot 2020-04-02T23:49:03.026 INFO:tasks.workunit.client.0.smithi082.stdout: create 234/39 file after the snapshot 2020-04-02T23:49:03.028 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/.snap/snap-subdir-test 2020-04-02T23:49:03.731 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/30 file after the snapshot 2020-04-02T23:49:03.733 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/31 file after the snapshot 2020-04-02T23:49:03.734 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/32 file after the snapshot 2020-04-02T23:49:03.736 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/33 file after the snapshot 2020-04-02T23:49:03.738 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/34 file after the snapshot 2020-04-02T23:49:03.740 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/35 file after the snapshot 2020-04-02T23:49:03.742 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/36 file after the snapshot 2020-04-02T23:49:03.744 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/37 file after the snapshot 2020-04-02T23:49:03.746 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/38 file after the snapshot 2020-04-02T23:49:03.748 INFO:tasks.workunit.client.0.smithi082.stdout: create 235/39 file after the snapshot 2020-04-02T23:49:03.750 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/.snap/snap-subdir-test 2020-04-02T23:49:03.772 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/30 file after the snapshot 2020-04-02T23:49:03.773 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/31 file after the snapshot 2020-04-02T23:49:03.776 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/32 file after the snapshot 2020-04-02T23:49:03.777 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/33 file after the snapshot 2020-04-02T23:49:03.779 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/34 file after the snapshot 2020-04-02T23:49:03.781 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/35 file after the snapshot 2020-04-02T23:49:03.783 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/36 file after the snapshot 2020-04-02T23:49:03.785 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/37 file after the snapshot 2020-04-02T23:49:03.787 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/38 file after the snapshot 2020-04-02T23:49:03.790 INFO:tasks.workunit.client.0.smithi082.stdout: create 236/39 file after the snapshot 2020-04-02T23:49:03.791 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/.snap/snap-subdir-test 2020-04-02T23:49:04.138 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/30 file after the snapshot 2020-04-02T23:49:04.140 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/31 file after the snapshot 2020-04-02T23:49:04.142 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/32 file after the snapshot 2020-04-02T23:49:04.144 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/33 file after the snapshot 2020-04-02T23:49:04.145 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/34 file after the snapshot 2020-04-02T23:49:04.147 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/35 file after the snapshot 2020-04-02T23:49:04.149 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/36 file after the snapshot 2020-04-02T23:49:04.151 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/37 file after the snapshot 2020-04-02T23:49:04.152 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/38 file after the snapshot 2020-04-02T23:49:04.154 INFO:tasks.workunit.client.0.smithi082.stdout: create 237/39 file after the snapshot 2020-04-02T23:49:04.157 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/.snap/snap-subdir-test 2020-04-02T23:49:04.860 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/30 file after the snapshot 2020-04-02T23:49:04.862 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/31 file after the snapshot 2020-04-02T23:49:04.864 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/32 file after the snapshot 2020-04-02T23:49:04.866 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/33 file after the snapshot 2020-04-02T23:49:04.869 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/34 file after the snapshot 2020-04-02T23:49:04.871 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/35 file after the snapshot 2020-04-02T23:49:04.873 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/36 file after the snapshot 2020-04-02T23:49:04.876 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/37 file after the snapshot 2020-04-02T23:49:04.877 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/38 file after the snapshot 2020-04-02T23:49:04.879 INFO:tasks.workunit.client.0.smithi082.stdout: create 238/39 file after the snapshot 2020-04-02T23:49:04.881 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/.snap/snap-subdir-test 2020-04-02T23:49:04.899 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/30 file after the snapshot 2020-04-02T23:49:04.901 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/31 file after the snapshot 2020-04-02T23:49:04.902 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/32 file after the snapshot 2020-04-02T23:49:04.905 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/33 file after the snapshot 2020-04-02T23:49:04.907 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/34 file after the snapshot 2020-04-02T23:49:04.908 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/35 file after the snapshot 2020-04-02T23:49:04.910 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/36 file after the snapshot 2020-04-02T23:49:04.912 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/37 file after the snapshot 2020-04-02T23:49:04.914 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/38 file after the snapshot 2020-04-02T23:49:04.917 INFO:tasks.workunit.client.0.smithi082.stdout: create 239/39 file after the snapshot 2020-04-02T23:49:04.918 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/.snap/snap-subdir-test 2020-04-02T23:49:04.935 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/30 file after the snapshot 2020-04-02T23:49:04.937 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/31 file after the snapshot 2020-04-02T23:49:04.938 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/32 file after the snapshot 2020-04-02T23:49:04.940 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/33 file after the snapshot 2020-04-02T23:49:04.942 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/34 file after the snapshot 2020-04-02T23:49:04.944 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/35 file after the snapshot 2020-04-02T23:49:04.946 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/36 file after the snapshot 2020-04-02T23:49:04.948 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/37 file after the snapshot 2020-04-02T23:49:04.950 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/38 file after the snapshot 2020-04-02T23:49:04.952 INFO:tasks.workunit.client.0.smithi082.stdout: create 240/39 file after the snapshot 2020-04-02T23:49:04.955 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/.snap/snap-subdir-test 2020-04-02T23:49:04.974 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/30 file after the snapshot 2020-04-02T23:49:05.004 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/31 file after the snapshot 2020-04-02T23:49:05.005 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/32 file after the snapshot 2020-04-02T23:49:05.007 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/33 file after the snapshot 2020-04-02T23:49:05.008 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/34 file after the snapshot 2020-04-02T23:49:05.010 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/35 file after the snapshot 2020-04-02T23:49:05.013 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/36 file after the snapshot 2020-04-02T23:49:05.015 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/37 file after the snapshot 2020-04-02T23:49:05.016 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/38 file after the snapshot 2020-04-02T23:49:05.018 INFO:tasks.workunit.client.0.smithi082.stdout: create 241/39 file after the snapshot 2020-04-02T23:49:05.021 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/.snap/snap-subdir-test 2020-04-02T23:49:05.468 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/30 file after the snapshot 2020-04-02T23:49:05.470 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/31 file after the snapshot 2020-04-02T23:49:05.472 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/32 file after the snapshot 2020-04-02T23:49:05.474 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/33 file after the snapshot 2020-04-02T23:49:05.475 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/34 file after the snapshot 2020-04-02T23:49:05.477 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/35 file after the snapshot 2020-04-02T23:49:05.478 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/36 file after the snapshot 2020-04-02T23:49:05.480 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/37 file after the snapshot 2020-04-02T23:49:05.482 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/38 file after the snapshot 2020-04-02T23:49:05.485 INFO:tasks.workunit.client.0.smithi082.stdout: create 242/39 file after the snapshot 2020-04-02T23:49:05.486 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/.snap/snap-subdir-test 2020-04-02T23:49:05.503 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/30 file after the snapshot 2020-04-02T23:49:05.506 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/31 file after the snapshot 2020-04-02T23:49:05.508 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/32 file after the snapshot 2020-04-02T23:49:05.509 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/33 file after the snapshot 2020-04-02T23:49:05.511 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/34 file after the snapshot 2020-04-02T23:49:05.513 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/35 file after the snapshot 2020-04-02T23:49:05.514 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/36 file after the snapshot 2020-04-02T23:49:05.516 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/37 file after the snapshot 2020-04-02T23:49:05.518 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/38 file after the snapshot 2020-04-02T23:49:05.521 INFO:tasks.workunit.client.0.smithi082.stdout: create 243/39 file after the snapshot 2020-04-02T23:49:05.522 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/.snap/snap-subdir-test 2020-04-02T23:49:05.539 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/30 file after the snapshot 2020-04-02T23:49:05.541 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/31 file after the snapshot 2020-04-02T23:49:05.542 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/32 file after the snapshot 2020-04-02T23:49:05.544 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/33 file after the snapshot 2020-04-02T23:49:05.546 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/34 file after the snapshot 2020-04-02T23:49:05.548 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/35 file after the snapshot 2020-04-02T23:49:05.549 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/36 file after the snapshot 2020-04-02T23:49:05.551 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/37 file after the snapshot 2020-04-02T23:49:05.553 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/38 file after the snapshot 2020-04-02T23:49:05.555 INFO:tasks.workunit.client.0.smithi082.stdout: create 244/39 file after the snapshot 2020-04-02T23:49:05.557 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/.snap/snap-subdir-test 2020-04-02T23:49:05.578 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/30 file after the snapshot 2020-04-02T23:49:05.578 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/31 file after the snapshot 2020-04-02T23:49:05.578 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/32 file after the snapshot 2020-04-02T23:49:05.579 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/33 file after the snapshot 2020-04-02T23:49:05.579 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/34 file after the snapshot 2020-04-02T23:49:05.585 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/35 file after the snapshot 2020-04-02T23:49:05.585 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/36 file after the snapshot 2020-04-02T23:49:05.585 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/37 file after the snapshot 2020-04-02T23:49:05.586 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/38 file after the snapshot 2020-04-02T23:49:05.592 INFO:tasks.workunit.client.0.smithi082.stdout: create 245/39 file after the snapshot 2020-04-02T23:49:05.592 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/.snap/snap-subdir-test 2020-04-02T23:49:05.605 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/30 file after the snapshot 2020-04-02T23:49:05.607 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/31 file after the snapshot 2020-04-02T23:49:05.609 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/32 file after the snapshot 2020-04-02T23:49:05.611 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/33 file after the snapshot 2020-04-02T23:49:05.612 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/34 file after the snapshot 2020-04-02T23:49:05.614 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/35 file after the snapshot 2020-04-02T23:49:05.616 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/36 file after the snapshot 2020-04-02T23:49:05.617 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/37 file after the snapshot 2020-04-02T23:49:05.620 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/38 file after the snapshot 2020-04-02T23:49:05.622 INFO:tasks.workunit.client.0.smithi082.stdout: create 246/39 file after the snapshot 2020-04-02T23:49:05.623 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/.snap/snap-subdir-test 2020-04-02T23:49:05.639 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/30 file after the snapshot 2020-04-02T23:49:05.641 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/31 file after the snapshot 2020-04-02T23:49:05.643 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/32 file after the snapshot 2020-04-02T23:49:05.644 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/33 file after the snapshot 2020-04-02T23:49:05.647 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/34 file after the snapshot 2020-04-02T23:49:05.648 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/35 file after the snapshot 2020-04-02T23:49:05.650 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/36 file after the snapshot 2020-04-02T23:49:05.652 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/37 file after the snapshot 2020-04-02T23:49:05.654 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/38 file after the snapshot 2020-04-02T23:49:05.656 INFO:tasks.workunit.client.0.smithi082.stdout: create 247/39 file after the snapshot 2020-04-02T23:49:05.658 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/.snap/snap-subdir-test 2020-04-02T23:49:05.674 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/30 file after the snapshot 2020-04-02T23:49:05.675 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/31 file after the snapshot 2020-04-02T23:49:05.677 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/32 file after the snapshot 2020-04-02T23:49:05.679 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/33 file after the snapshot 2020-04-02T23:49:05.681 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/34 file after the snapshot 2020-04-02T23:49:05.682 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/35 file after the snapshot 2020-04-02T23:49:05.684 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/36 file after the snapshot 2020-04-02T23:49:05.686 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/37 file after the snapshot 2020-04-02T23:49:05.688 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/38 file after the snapshot 2020-04-02T23:49:05.690 INFO:tasks.workunit.client.0.smithi082.stdout: create 248/39 file after the snapshot 2020-04-02T23:49:05.692 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/.snap/snap-subdir-test 2020-04-02T23:49:05.976 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/30 file after the snapshot 2020-04-02T23:49:06.014 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/31 file after the snapshot 2020-04-02T23:49:06.015 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/32 file after the snapshot 2020-04-02T23:49:06.017 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/33 file after the snapshot 2020-04-02T23:49:06.019 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/34 file after the snapshot 2020-04-02T23:49:06.020 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/35 file after the snapshot 2020-04-02T23:49:06.022 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/36 file after the snapshot 2020-04-02T23:49:06.025 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/37 file after the snapshot 2020-04-02T23:49:06.027 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/38 file after the snapshot 2020-04-02T23:49:06.029 INFO:tasks.workunit.client.0.smithi082.stdout: create 249/39 file after the snapshot 2020-04-02T23:49:06.031 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/.snap/snap-subdir-test 2020-04-02T23:49:06.899 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/30 file after the snapshot 2020-04-02T23:49:06.901 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/31 file after the snapshot 2020-04-02T23:49:06.902 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/32 file after the snapshot 2020-04-02T23:49:06.904 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/33 file after the snapshot 2020-04-02T23:49:06.906 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/34 file after the snapshot 2020-04-02T23:49:06.908 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/35 file after the snapshot 2020-04-02T23:49:06.911 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/36 file after the snapshot 2020-04-02T23:49:06.913 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/37 file after the snapshot 2020-04-02T23:49:06.915 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/38 file after the snapshot 2020-04-02T23:49:06.917 INFO:tasks.workunit.client.0.smithi082.stdout: create 250/39 file after the snapshot 2020-04-02T23:49:06.919 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/.snap/snap-subdir-test 2020-04-02T23:49:07.382 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/30 file after the snapshot 2020-04-02T23:49:07.384 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/31 file after the snapshot 2020-04-02T23:49:07.386 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/32 file after the snapshot 2020-04-02T23:49:07.388 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/33 file after the snapshot 2020-04-02T23:49:07.391 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/34 file after the snapshot 2020-04-02T23:49:07.393 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/35 file after the snapshot 2020-04-02T23:49:07.395 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/36 file after the snapshot 2020-04-02T23:49:07.397 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/37 file after the snapshot 2020-04-02T23:49:07.400 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/38 file after the snapshot 2020-04-02T23:49:07.402 INFO:tasks.workunit.client.0.smithi082.stdout: create 251/39 file after the snapshot 2020-04-02T23:49:07.405 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/.snap/snap-subdir-test 2020-04-02T23:49:08.391 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/30 file after the snapshot 2020-04-02T23:49:08.393 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/31 file after the snapshot 2020-04-02T23:49:08.396 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/32 file after the snapshot 2020-04-02T23:49:08.398 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/33 file after the snapshot 2020-04-02T23:49:08.400 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/34 file after the snapshot 2020-04-02T23:49:08.402 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/35 file after the snapshot 2020-04-02T23:49:08.404 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/36 file after the snapshot 2020-04-02T23:49:08.407 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/37 file after the snapshot 2020-04-02T23:49:08.409 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/38 file after the snapshot 2020-04-02T23:49:08.413 INFO:tasks.workunit.client.0.smithi082.stdout: create 252/39 file after the snapshot 2020-04-02T23:49:08.416 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/.snap/snap-subdir-test 2020-04-02T23:49:08.972 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/30 file after the snapshot 2020-04-02T23:49:08.991 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/31 file after the snapshot 2020-04-02T23:49:08.993 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/32 file after the snapshot 2020-04-02T23:49:08.995 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/33 file after the snapshot 2020-04-02T23:49:08.998 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/34 file after the snapshot 2020-04-02T23:49:09.001 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/35 file after the snapshot 2020-04-02T23:49:09.002 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/36 file after the snapshot 2020-04-02T23:49:09.005 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/37 file after the snapshot 2020-04-02T23:49:09.007 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/38 file after the snapshot 2020-04-02T23:49:09.009 INFO:tasks.workunit.client.0.smithi082.stdout: create 253/39 file after the snapshot 2020-04-02T23:49:09.011 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/.snap/snap-subdir-test 2020-04-02T23:49:09.037 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/30 file after the snapshot 2020-04-02T23:49:09.038 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/31 file after the snapshot 2020-04-02T23:49:09.040 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/32 file after the snapshot 2020-04-02T23:49:09.043 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/33 file after the snapshot 2020-04-02T23:49:09.044 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/34 file after the snapshot 2020-04-02T23:49:09.046 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/35 file after the snapshot 2020-04-02T23:49:09.049 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/36 file after the snapshot 2020-04-02T23:49:09.051 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/37 file after the snapshot 2020-04-02T23:49:09.053 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/38 file after the snapshot 2020-04-02T23:49:09.055 INFO:tasks.workunit.client.0.smithi082.stdout: create 254/39 file after the snapshot 2020-04-02T23:49:09.057 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/.snap/snap-subdir-test 2020-04-02T23:49:09.074 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/30 file after the snapshot 2020-04-02T23:49:09.076 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/31 file after the snapshot 2020-04-02T23:49:09.077 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/32 file after the snapshot 2020-04-02T23:49:09.079 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/33 file after the snapshot 2020-04-02T23:49:09.081 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/34 file after the snapshot 2020-04-02T23:49:09.083 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/35 file after the snapshot 2020-04-02T23:49:09.085 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/36 file after the snapshot 2020-04-02T23:49:09.086 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/37 file after the snapshot 2020-04-02T23:49:09.088 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/38 file after the snapshot 2020-04-02T23:49:09.090 INFO:tasks.workunit.client.0.smithi082.stdout: create 255/39 file after the snapshot 2020-04-02T23:49:09.092 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/.snap/snap-subdir-test 2020-04-02T23:49:09.109 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/30 file after the snapshot 2020-04-02T23:49:09.111 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/31 file after the snapshot 2020-04-02T23:49:09.113 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/32 file after the snapshot 2020-04-02T23:49:09.115 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/33 file after the snapshot 2020-04-02T23:49:09.116 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/34 file after the snapshot 2020-04-02T23:49:09.118 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/35 file after the snapshot 2020-04-02T23:49:09.143 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/36 file after the snapshot 2020-04-02T23:49:09.145 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/37 file after the snapshot 2020-04-02T23:49:09.146 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/38 file after the snapshot 2020-04-02T23:49:09.148 INFO:tasks.workunit.client.0.smithi082.stdout: create 256/39 file after the snapshot 2020-04-02T23:49:09.150 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/.snap/snap-subdir-test 2020-04-02T23:49:09.166 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/30 file after the snapshot 2020-04-02T23:49:09.168 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/31 file after the snapshot 2020-04-02T23:49:09.867 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/32 file after the snapshot 2020-04-02T23:49:09.869 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/33 file after the snapshot 2020-04-02T23:49:09.872 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/34 file after the snapshot 2020-04-02T23:49:09.875 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/35 file after the snapshot 2020-04-02T23:49:09.877 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/36 file after the snapshot 2020-04-02T23:49:09.879 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/37 file after the snapshot 2020-04-02T23:49:09.881 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/38 file after the snapshot 2020-04-02T23:49:09.884 INFO:tasks.workunit.client.0.smithi082.stdout: create 257/39 file after the snapshot 2020-04-02T23:49:09.886 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/.snap/snap-subdir-test 2020-04-02T23:49:09.905 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/30 file after the snapshot 2020-04-02T23:49:09.906 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/31 file after the snapshot 2020-04-02T23:49:09.908 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/32 file after the snapshot 2020-04-02T23:49:09.910 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/33 file after the snapshot 2020-04-02T23:49:09.912 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/34 file after the snapshot 2020-04-02T23:49:09.915 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/35 file after the snapshot 2020-04-02T23:49:09.916 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/36 file after the snapshot 2020-04-02T23:49:09.918 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/37 file after the snapshot 2020-04-02T23:49:09.920 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/38 file after the snapshot 2020-04-02T23:49:09.922 INFO:tasks.workunit.client.0.smithi082.stdout: create 258/39 file after the snapshot 2020-04-02T23:49:09.924 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/.snap/snap-subdir-test 2020-04-02T23:49:09.941 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/30 file after the snapshot 2020-04-02T23:49:09.943 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/31 file after the snapshot 2020-04-02T23:49:09.944 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/32 file after the snapshot 2020-04-02T23:49:09.946 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/33 file after the snapshot 2020-04-02T23:49:09.948 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/34 file after the snapshot 2020-04-02T23:49:09.950 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/35 file after the snapshot 2020-04-02T23:49:09.952 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/36 file after the snapshot 2020-04-02T23:49:09.954 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/37 file after the snapshot 2020-04-02T23:49:09.956 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/38 file after the snapshot 2020-04-02T23:49:09.957 INFO:tasks.workunit.client.0.smithi082.stdout: create 259/39 file after the snapshot 2020-04-02T23:49:09.959 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/.snap/snap-subdir-test 2020-04-02T23:49:09.976 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/30 file after the snapshot 2020-04-02T23:49:09.994 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/31 file after the snapshot 2020-04-02T23:49:09.995 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/32 file after the snapshot 2020-04-02T23:49:09.997 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/33 file after the snapshot 2020-04-02T23:49:09.999 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/34 file after the snapshot 2020-04-02T23:49:10.001 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/35 file after the snapshot 2020-04-02T23:49:10.002 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/36 file after the snapshot 2020-04-02T23:49:10.004 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/37 file after the snapshot 2020-04-02T23:49:10.006 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/38 file after the snapshot 2020-04-02T23:49:10.008 INFO:tasks.workunit.client.0.smithi082.stdout: create 260/39 file after the snapshot 2020-04-02T23:49:10.011 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/.snap/snap-subdir-test 2020-04-02T23:49:10.036 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/30 file after the snapshot 2020-04-02T23:49:10.042 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/31 file after the snapshot 2020-04-02T23:49:10.043 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/32 file after the snapshot 2020-04-02T23:49:10.043 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/33 file after the snapshot 2020-04-02T23:49:10.043 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/34 file after the snapshot 2020-04-02T23:49:10.043 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/35 file after the snapshot 2020-04-02T23:49:10.046 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/36 file after the snapshot 2020-04-02T23:49:10.046 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/37 file after the snapshot 2020-04-02T23:49:10.048 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/38 file after the snapshot 2020-04-02T23:49:10.050 INFO:tasks.workunit.client.0.smithi082.stdout: create 261/39 file after the snapshot 2020-04-02T23:49:10.051 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/.snap/snap-subdir-test 2020-04-02T23:49:10.068 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/30 file after the snapshot 2020-04-02T23:49:10.069 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/31 file after the snapshot 2020-04-02T23:49:10.071 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/32 file after the snapshot 2020-04-02T23:49:10.073 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/33 file after the snapshot 2020-04-02T23:49:10.075 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/34 file after the snapshot 2020-04-02T23:49:10.077 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/35 file after the snapshot 2020-04-02T23:49:10.079 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/36 file after the snapshot 2020-04-02T23:49:10.080 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/37 file after the snapshot 2020-04-02T23:49:10.082 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/38 file after the snapshot 2020-04-02T23:49:10.084 INFO:tasks.workunit.client.0.smithi082.stdout: create 262/39 file after the snapshot 2020-04-02T23:49:10.086 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/.snap/snap-subdir-test 2020-04-02T23:49:10.347 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/30 file after the snapshot 2020-04-02T23:49:10.348 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/31 file after the snapshot 2020-04-02T23:49:10.350 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/32 file after the snapshot 2020-04-02T23:49:10.353 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/33 file after the snapshot 2020-04-02T23:49:10.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/34 file after the snapshot 2020-04-02T23:49:10.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/35 file after the snapshot 2020-04-02T23:49:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/36 file after the snapshot 2020-04-02T23:49:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/37 file after the snapshot 2020-04-02T23:49:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/38 file after the snapshot 2020-04-02T23:49:10.363 INFO:tasks.workunit.client.0.smithi082.stdout: create 263/39 file after the snapshot 2020-04-02T23:49:10.364 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/.snap/snap-subdir-test 2020-04-02T23:49:10.381 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/30 file after the snapshot 2020-04-02T23:49:10.383 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/31 file after the snapshot 2020-04-02T23:49:10.384 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/32 file after the snapshot 2020-04-02T23:49:10.386 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/33 file after the snapshot 2020-04-02T23:49:10.388 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/34 file after the snapshot 2020-04-02T23:49:10.390 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/35 file after the snapshot 2020-04-02T23:49:10.392 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/36 file after the snapshot 2020-04-02T23:49:10.394 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/37 file after the snapshot 2020-04-02T23:49:10.396 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/38 file after the snapshot 2020-04-02T23:49:10.398 INFO:tasks.workunit.client.0.smithi082.stdout: create 264/39 file after the snapshot 2020-04-02T23:49:10.399 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/.snap/snap-subdir-test 2020-04-02T23:49:10.415 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/30 file after the snapshot 2020-04-02T23:49:10.416 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/31 file after the snapshot 2020-04-02T23:49:10.418 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/32 file after the snapshot 2020-04-02T23:49:10.420 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/33 file after the snapshot 2020-04-02T23:49:10.422 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/34 file after the snapshot 2020-04-02T23:49:10.423 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/35 file after the snapshot 2020-04-02T23:49:10.425 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/36 file after the snapshot 2020-04-02T23:49:10.427 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/37 file after the snapshot 2020-04-02T23:49:10.429 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/38 file after the snapshot 2020-04-02T23:49:10.431 INFO:tasks.workunit.client.0.smithi082.stdout: create 265/39 file after the snapshot 2020-04-02T23:49:10.433 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/.snap/snap-subdir-test 2020-04-02T23:49:10.449 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/30 file after the snapshot 2020-04-02T23:49:10.451 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/31 file after the snapshot 2020-04-02T23:49:10.452 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/32 file after the snapshot 2020-04-02T23:49:10.453 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/33 file after the snapshot 2020-04-02T23:49:10.455 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/34 file after the snapshot 2020-04-02T23:49:10.457 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/35 file after the snapshot 2020-04-02T23:49:10.459 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/36 file after the snapshot 2020-04-02T23:49:10.460 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/37 file after the snapshot 2020-04-02T23:49:10.462 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/38 file after the snapshot 2020-04-02T23:49:10.464 INFO:tasks.workunit.client.0.smithi082.stdout: create 266/39 file after the snapshot 2020-04-02T23:49:10.466 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/.snap/snap-subdir-test 2020-04-02T23:49:10.483 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/30 file after the snapshot 2020-04-02T23:49:10.484 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/31 file after the snapshot 2020-04-02T23:49:10.486 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/32 file after the snapshot 2020-04-02T23:49:10.487 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/33 file after the snapshot 2020-04-02T23:49:10.489 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/34 file after the snapshot 2020-04-02T23:49:10.505 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/35 file after the snapshot 2020-04-02T23:49:10.507 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/36 file after the snapshot 2020-04-02T23:49:10.508 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/37 file after the snapshot 2020-04-02T23:49:10.510 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/38 file after the snapshot 2020-04-02T23:49:10.513 INFO:tasks.workunit.client.0.smithi082.stdout: create 267/39 file after the snapshot 2020-04-02T23:49:10.514 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/.snap/snap-subdir-test 2020-04-02T23:49:10.530 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/30 file after the snapshot 2020-04-02T23:49:10.532 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/31 file after the snapshot 2020-04-02T23:49:10.533 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/32 file after the snapshot 2020-04-02T23:49:10.535 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/33 file after the snapshot 2020-04-02T23:49:10.537 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/34 file after the snapshot 2020-04-02T23:49:10.538 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/35 file after the snapshot 2020-04-02T23:49:10.540 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/36 file after the snapshot 2020-04-02T23:49:10.542 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/37 file after the snapshot 2020-04-02T23:49:10.544 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/38 file after the snapshot 2020-04-02T23:49:10.546 INFO:tasks.workunit.client.0.smithi082.stdout: create 268/39 file after the snapshot 2020-04-02T23:49:10.547 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/.snap/snap-subdir-test 2020-04-02T23:49:11.042 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/30 file after the snapshot 2020-04-02T23:49:11.043 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/31 file after the snapshot 2020-04-02T23:49:11.045 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/32 file after the snapshot 2020-04-02T23:49:11.047 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/33 file after the snapshot 2020-04-02T23:49:11.048 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/34 file after the snapshot 2020-04-02T23:49:11.050 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/35 file after the snapshot 2020-04-02T23:49:11.052 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/36 file after the snapshot 2020-04-02T23:49:11.054 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/37 file after the snapshot 2020-04-02T23:49:11.055 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/38 file after the snapshot 2020-04-02T23:49:11.057 INFO:tasks.workunit.client.0.smithi082.stdout: create 269/39 file after the snapshot 2020-04-02T23:49:11.059 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/.snap/snap-subdir-test 2020-04-02T23:49:11.074 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/30 file after the snapshot 2020-04-02T23:49:11.075 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/31 file after the snapshot 2020-04-02T23:49:11.077 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/32 file after the snapshot 2020-04-02T23:49:11.079 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/33 file after the snapshot 2020-04-02T23:49:11.081 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/34 file after the snapshot 2020-04-02T23:49:11.083 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/35 file after the snapshot 2020-04-02T23:49:11.086 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/36 file after the snapshot 2020-04-02T23:49:11.086 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/37 file after the snapshot 2020-04-02T23:49:11.088 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/38 file after the snapshot 2020-04-02T23:49:11.090 INFO:tasks.workunit.client.0.smithi082.stdout: create 270/39 file after the snapshot 2020-04-02T23:49:11.093 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/.snap/snap-subdir-test 2020-04-02T23:49:11.109 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/30 file after the snapshot 2020-04-02T23:49:11.110 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/31 file after the snapshot 2020-04-02T23:49:11.111 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/32 file after the snapshot 2020-04-02T23:49:11.113 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/33 file after the snapshot 2020-04-02T23:49:11.115 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/34 file after the snapshot 2020-04-02T23:49:11.116 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/35 file after the snapshot 2020-04-02T23:49:11.118 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/36 file after the snapshot 2020-04-02T23:49:11.120 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/37 file after the snapshot 2020-04-02T23:49:11.122 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/38 file after the snapshot 2020-04-02T23:49:11.124 INFO:tasks.workunit.client.0.smithi082.stdout: create 271/39 file after the snapshot 2020-04-02T23:49:11.126 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/.snap/snap-subdir-test 2020-04-02T23:49:11.141 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/30 file after the snapshot 2020-04-02T23:49:11.142 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/31 file after the snapshot 2020-04-02T23:49:11.144 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/32 file after the snapshot 2020-04-02T23:49:11.145 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/33 file after the snapshot 2020-04-02T23:49:11.147 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/34 file after the snapshot 2020-04-02T23:49:11.148 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/35 file after the snapshot 2020-04-02T23:49:11.152 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/36 file after the snapshot 2020-04-02T23:49:11.153 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/37 file after the snapshot 2020-04-02T23:49:11.156 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/38 file after the snapshot 2020-04-02T23:49:11.157 INFO:tasks.workunit.client.0.smithi082.stdout: create 272/39 file after the snapshot 2020-04-02T23:49:11.159 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/.snap/snap-subdir-test 2020-04-02T23:49:11.174 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/30 file after the snapshot 2020-04-02T23:49:11.176 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/31 file after the snapshot 2020-04-02T23:49:11.178 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/32 file after the snapshot 2020-04-02T23:49:11.180 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/33 file after the snapshot 2020-04-02T23:49:11.181 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/34 file after the snapshot 2020-04-02T23:49:11.183 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/35 file after the snapshot 2020-04-02T23:49:11.184 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/36 file after the snapshot 2020-04-02T23:49:11.186 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/37 file after the snapshot 2020-04-02T23:49:11.188 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/38 file after the snapshot 2020-04-02T23:49:11.190 INFO:tasks.workunit.client.0.smithi082.stdout: create 273/39 file after the snapshot 2020-04-02T23:49:11.191 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/.snap/snap-subdir-test 2020-04-02T23:49:11.207 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/30 file after the snapshot 2020-04-02T23:49:11.208 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/31 file after the snapshot 2020-04-02T23:49:11.210 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/32 file after the snapshot 2020-04-02T23:49:11.212 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/33 file after the snapshot 2020-04-02T23:49:11.213 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/34 file after the snapshot 2020-04-02T23:49:11.215 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/35 file after the snapshot 2020-04-02T23:49:11.217 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/36 file after the snapshot 2020-04-02T23:49:11.218 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/37 file after the snapshot 2020-04-02T23:49:11.220 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/38 file after the snapshot 2020-04-02T23:49:11.222 INFO:tasks.workunit.client.0.smithi082.stdout: create 274/39 file after the snapshot 2020-04-02T23:49:11.224 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/.snap/snap-subdir-test 2020-04-02T23:49:11.242 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/30 file after the snapshot 2020-04-02T23:49:11.243 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/31 file after the snapshot 2020-04-02T23:49:11.243 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/32 file after the snapshot 2020-04-02T23:49:11.244 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/33 file after the snapshot 2020-04-02T23:49:11.245 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/34 file after the snapshot 2020-04-02T23:49:11.247 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/35 file after the snapshot 2020-04-02T23:49:11.249 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/36 file after the snapshot 2020-04-02T23:49:11.251 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/37 file after the snapshot 2020-04-02T23:49:11.253 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/38 file after the snapshot 2020-04-02T23:49:11.255 INFO:tasks.workunit.client.0.smithi082.stdout: create 275/39 file after the snapshot 2020-04-02T23:49:11.256 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/.snap/snap-subdir-test 2020-04-02T23:49:11.271 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/30 file after the snapshot 2020-04-02T23:49:11.272 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/31 file after the snapshot 2020-04-02T23:49:11.274 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/32 file after the snapshot 2020-04-02T23:49:11.276 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/33 file after the snapshot 2020-04-02T23:49:11.279 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/34 file after the snapshot 2020-04-02T23:49:11.279 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/35 file after the snapshot 2020-04-02T23:49:11.281 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/36 file after the snapshot 2020-04-02T23:49:11.282 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/37 file after the snapshot 2020-04-02T23:49:11.284 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/38 file after the snapshot 2020-04-02T23:49:11.286 INFO:tasks.workunit.client.0.smithi082.stdout: create 276/39 file after the snapshot 2020-04-02T23:49:11.294 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/.snap/snap-subdir-test 2020-04-02T23:49:11.303 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/30 file after the snapshot 2020-04-02T23:49:11.304 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/31 file after the snapshot 2020-04-02T23:49:11.306 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/32 file after the snapshot 2020-04-02T23:49:11.308 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/33 file after the snapshot 2020-04-02T23:49:11.310 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/34 file after the snapshot 2020-04-02T23:49:11.311 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/35 file after the snapshot 2020-04-02T23:49:11.313 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/36 file after the snapshot 2020-04-02T23:49:11.314 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/37 file after the snapshot 2020-04-02T23:49:11.316 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/38 file after the snapshot 2020-04-02T23:49:11.318 INFO:tasks.workunit.client.0.smithi082.stdout: create 277/39 file after the snapshot 2020-04-02T23:49:11.320 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/.snap/snap-subdir-test 2020-04-02T23:49:11.336 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/30 file after the snapshot 2020-04-02T23:49:11.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/31 file after the snapshot 2020-04-02T23:49:11.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/32 file after the snapshot 2020-04-02T23:49:11.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/33 file after the snapshot 2020-04-02T23:49:11.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/34 file after the snapshot 2020-04-02T23:49:11.354 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/35 file after the snapshot 2020-04-02T23:49:11.355 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/36 file after the snapshot 2020-04-02T23:49:11.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/37 file after the snapshot 2020-04-02T23:49:11.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/38 file after the snapshot 2020-04-02T23:49:11.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 278/39 file after the snapshot 2020-04-02T23:49:11.356 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/.snap/snap-subdir-test 2020-04-02T23:49:11.370 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/30 file after the snapshot 2020-04-02T23:49:11.371 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/31 file after the snapshot 2020-04-02T23:49:11.373 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/32 file after the snapshot 2020-04-02T23:49:11.375 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/33 file after the snapshot 2020-04-02T23:49:11.377 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/34 file after the snapshot 2020-04-02T23:49:11.379 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/35 file after the snapshot 2020-04-02T23:49:11.381 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/36 file after the snapshot 2020-04-02T23:49:11.382 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/37 file after the snapshot 2020-04-02T23:49:11.384 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/38 file after the snapshot 2020-04-02T23:49:11.386 INFO:tasks.workunit.client.0.smithi082.stdout: create 279/39 file after the snapshot 2020-04-02T23:49:11.388 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/.snap/snap-subdir-test 2020-04-02T23:49:11.404 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/30 file after the snapshot 2020-04-02T23:49:11.406 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/31 file after the snapshot 2020-04-02T23:49:11.408 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/32 file after the snapshot 2020-04-02T23:49:11.410 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/33 file after the snapshot 2020-04-02T23:49:11.412 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/34 file after the snapshot 2020-04-02T23:49:11.414 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/35 file after the snapshot 2020-04-02T23:49:11.416 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/36 file after the snapshot 2020-04-02T23:49:11.418 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/37 file after the snapshot 2020-04-02T23:49:11.420 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/38 file after the snapshot 2020-04-02T23:49:11.421 INFO:tasks.workunit.client.0.smithi082.stdout: create 280/39 file after the snapshot 2020-04-02T23:49:11.423 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/.snap/snap-subdir-test 2020-04-02T23:49:11.718 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/30 file after the snapshot 2020-04-02T23:49:11.720 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/31 file after the snapshot 2020-04-02T23:49:11.729 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/32 file after the snapshot 2020-04-02T23:49:11.731 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/33 file after the snapshot 2020-04-02T23:49:11.732 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/34 file after the snapshot 2020-04-02T23:49:11.734 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/35 file after the snapshot 2020-04-02T23:49:11.736 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/36 file after the snapshot 2020-04-02T23:49:11.738 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/37 file after the snapshot 2020-04-02T23:49:11.740 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/38 file after the snapshot 2020-04-02T23:49:11.743 INFO:tasks.workunit.client.0.smithi082.stdout: create 281/39 file after the snapshot 2020-04-02T23:49:11.745 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/.snap/snap-subdir-test 2020-04-02T23:49:12.323 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/30 file after the snapshot 2020-04-02T23:49:12.325 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/31 file after the snapshot 2020-04-02T23:49:12.326 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/32 file after the snapshot 2020-04-02T23:49:12.328 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/33 file after the snapshot 2020-04-02T23:49:12.330 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/34 file after the snapshot 2020-04-02T23:49:12.332 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/35 file after the snapshot 2020-04-02T23:49:12.335 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/36 file after the snapshot 2020-04-02T23:49:12.337 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/37 file after the snapshot 2020-04-02T23:49:12.339 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/38 file after the snapshot 2020-04-02T23:49:12.340 INFO:tasks.workunit.client.0.smithi082.stdout: create 282/39 file after the snapshot 2020-04-02T23:49:12.343 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/.snap/snap-subdir-test 2020-04-02T23:49:12.366 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/30 file after the snapshot 2020-04-02T23:49:12.367 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/31 file after the snapshot 2020-04-02T23:49:12.369 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/32 file after the snapshot 2020-04-02T23:49:12.371 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/33 file after the snapshot 2020-04-02T23:49:12.374 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/34 file after the snapshot 2020-04-02T23:49:12.376 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/35 file after the snapshot 2020-04-02T23:49:12.377 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/36 file after the snapshot 2020-04-02T23:49:12.379 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/37 file after the snapshot 2020-04-02T23:49:12.381 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/38 file after the snapshot 2020-04-02T23:49:12.382 INFO:tasks.workunit.client.0.smithi082.stdout: create 283/39 file after the snapshot 2020-04-02T23:49:12.384 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/.snap/snap-subdir-test 2020-04-02T23:49:12.400 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/30 file after the snapshot 2020-04-02T23:49:12.403 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/31 file after the snapshot 2020-04-02T23:49:12.404 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/32 file after the snapshot 2020-04-02T23:49:12.406 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/33 file after the snapshot 2020-04-02T23:49:12.410 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/34 file after the snapshot 2020-04-02T23:49:12.411 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/35 file after the snapshot 2020-04-02T23:49:12.413 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/36 file after the snapshot 2020-04-02T23:49:12.415 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/37 file after the snapshot 2020-04-02T23:49:12.417 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/38 file after the snapshot 2020-04-02T23:49:12.419 INFO:tasks.workunit.client.0.smithi082.stdout: create 284/39 file after the snapshot 2020-04-02T23:49:12.421 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/.snap/snap-subdir-test 2020-04-02T23:49:12.438 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/30 file after the snapshot 2020-04-02T23:49:12.439 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/31 file after the snapshot 2020-04-02T23:49:12.441 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/32 file after the snapshot 2020-04-02T23:49:12.443 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/33 file after the snapshot 2020-04-02T23:49:12.445 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/34 file after the snapshot 2020-04-02T23:49:12.447 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/35 file after the snapshot 2020-04-02T23:49:12.450 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/36 file after the snapshot 2020-04-02T23:49:12.450 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/37 file after the snapshot 2020-04-02T23:49:12.452 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/38 file after the snapshot 2020-04-02T23:49:12.454 INFO:tasks.workunit.client.0.smithi082.stdout: create 285/39 file after the snapshot 2020-04-02T23:49:12.456 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/.snap/snap-subdir-test 2020-04-02T23:49:12.473 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/30 file after the snapshot 2020-04-02T23:49:12.474 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/31 file after the snapshot 2020-04-02T23:49:12.476 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/32 file after the snapshot 2020-04-02T23:49:12.478 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/33 file after the snapshot 2020-04-02T23:49:12.479 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/34 file after the snapshot 2020-04-02T23:49:12.481 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/35 file after the snapshot 2020-04-02T23:49:12.483 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/36 file after the snapshot 2020-04-02T23:49:12.485 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/37 file after the snapshot 2020-04-02T23:49:12.486 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/38 file after the snapshot 2020-04-02T23:49:12.488 INFO:tasks.workunit.client.0.smithi082.stdout: create 286/39 file after the snapshot 2020-04-02T23:49:12.489 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/.snap/snap-subdir-test 2020-04-02T23:49:12.506 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/30 file after the snapshot 2020-04-02T23:49:12.508 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/31 file after the snapshot 2020-04-02T23:49:12.513 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/32 file after the snapshot 2020-04-02T23:49:12.513 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/33 file after the snapshot 2020-04-02T23:49:12.513 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/34 file after the snapshot 2020-04-02T23:49:12.514 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/35 file after the snapshot 2020-04-02T23:49:12.516 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/36 file after the snapshot 2020-04-02T23:49:12.520 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/37 file after the snapshot 2020-04-02T23:49:12.520 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/38 file after the snapshot 2020-04-02T23:49:12.522 INFO:tasks.workunit.client.0.smithi082.stdout: create 287/39 file after the snapshot 2020-04-02T23:49:12.524 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/.snap/snap-subdir-test 2020-04-02T23:49:12.541 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/30 file after the snapshot 2020-04-02T23:49:12.542 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/31 file after the snapshot 2020-04-02T23:49:12.544 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/32 file after the snapshot 2020-04-02T23:49:12.546 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/33 file after the snapshot 2020-04-02T23:49:12.547 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/34 file after the snapshot 2020-04-02T23:49:12.549 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/35 file after the snapshot 2020-04-02T23:49:12.553 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/36 file after the snapshot 2020-04-02T23:49:12.553 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/37 file after the snapshot 2020-04-02T23:49:12.557 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/38 file after the snapshot 2020-04-02T23:49:12.557 INFO:tasks.workunit.client.0.smithi082.stdout: create 288/39 file after the snapshot 2020-04-02T23:49:12.557 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/.snap/snap-subdir-test 2020-04-02T23:49:12.575 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/30 file after the snapshot 2020-04-02T23:49:12.577 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/31 file after the snapshot 2020-04-02T23:49:12.582 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/32 file after the snapshot 2020-04-02T23:49:13.294 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/33 file after the snapshot 2020-04-02T23:49:13.296 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/34 file after the snapshot 2020-04-02T23:49:13.298 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/35 file after the snapshot 2020-04-02T23:49:13.300 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/36 file after the snapshot 2020-04-02T23:49:13.302 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/37 file after the snapshot 2020-04-02T23:49:13.304 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/38 file after the snapshot 2020-04-02T23:49:13.306 INFO:tasks.workunit.client.0.smithi082.stdout: create 289/39 file after the snapshot 2020-04-02T23:49:13.308 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/.snap/snap-subdir-test 2020-04-02T23:49:13.329 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/30 file after the snapshot 2020-04-02T23:49:13.330 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/31 file after the snapshot 2020-04-02T23:49:13.333 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/32 file after the snapshot 2020-04-02T23:49:13.335 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/33 file after the snapshot 2020-04-02T23:49:13.337 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/34 file after the snapshot 2020-04-02T23:49:13.339 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/35 file after the snapshot 2020-04-02T23:49:13.341 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/36 file after the snapshot 2020-04-02T23:49:13.342 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/37 file after the snapshot 2020-04-02T23:49:13.345 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/38 file after the snapshot 2020-04-02T23:49:13.347 INFO:tasks.workunit.client.0.smithi082.stdout: create 290/39 file after the snapshot 2020-04-02T23:49:13.348 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/.snap/snap-subdir-test 2020-04-02T23:49:13.365 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/30 file after the snapshot 2020-04-02T23:49:13.366 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/31 file after the snapshot 2020-04-02T23:49:13.368 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/32 file after the snapshot 2020-04-02T23:49:13.369 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/33 file after the snapshot 2020-04-02T23:49:13.371 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/34 file after the snapshot 2020-04-02T23:49:13.373 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/35 file after the snapshot 2020-04-02T23:49:13.375 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/36 file after the snapshot 2020-04-02T23:49:13.377 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/37 file after the snapshot 2020-04-02T23:49:13.379 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/38 file after the snapshot 2020-04-02T23:49:13.381 INFO:tasks.workunit.client.0.smithi082.stdout: create 291/39 file after the snapshot 2020-04-02T23:49:13.383 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/.snap/snap-subdir-test 2020-04-02T23:49:13.400 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/30 file after the snapshot 2020-04-02T23:49:13.402 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/31 file after the snapshot 2020-04-02T23:49:13.403 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/32 file after the snapshot 2020-04-02T23:49:13.405 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/33 file after the snapshot 2020-04-02T23:49:13.407 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/34 file after the snapshot 2020-04-02T23:49:13.408 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/35 file after the snapshot 2020-04-02T23:49:13.410 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/36 file after the snapshot 2020-04-02T23:49:13.412 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/37 file after the snapshot 2020-04-02T23:49:13.414 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/38 file after the snapshot 2020-04-02T23:49:13.415 INFO:tasks.workunit.client.0.smithi082.stdout: create 292/39 file after the snapshot 2020-04-02T23:49:13.417 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/.snap/snap-subdir-test 2020-04-02T23:49:13.433 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/30 file after the snapshot 2020-04-02T23:49:13.434 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/31 file after the snapshot 2020-04-02T23:49:13.436 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/32 file after the snapshot 2020-04-02T23:49:13.438 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/33 file after the snapshot 2020-04-02T23:49:13.439 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/34 file after the snapshot 2020-04-02T23:49:13.441 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/35 file after the snapshot 2020-04-02T23:49:13.443 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/36 file after the snapshot 2020-04-02T23:49:13.444 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/37 file after the snapshot 2020-04-02T23:49:13.446 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/38 file after the snapshot 2020-04-02T23:49:13.448 INFO:tasks.workunit.client.0.smithi082.stdout: create 293/39 file after the snapshot 2020-04-02T23:49:13.450 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/.snap/snap-subdir-test 2020-04-02T23:49:13.464 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/30 file after the snapshot 2020-04-02T23:49:13.466 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/31 file after the snapshot 2020-04-02T23:49:13.467 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/32 file after the snapshot 2020-04-02T23:49:13.469 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/33 file after the snapshot 2020-04-02T23:49:13.471 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/34 file after the snapshot 2020-04-02T23:49:13.473 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/35 file after the snapshot 2020-04-02T23:49:13.474 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/36 file after the snapshot 2020-04-02T23:49:13.476 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/37 file after the snapshot 2020-04-02T23:49:13.477 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/38 file after the snapshot 2020-04-02T23:49:13.480 INFO:tasks.workunit.client.0.smithi082.stdout: create 294/39 file after the snapshot 2020-04-02T23:49:13.481 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/.snap/snap-subdir-test 2020-04-02T23:49:15.066 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/30 file after the snapshot 2020-04-02T23:49:15.068 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/31 file after the snapshot 2020-04-02T23:49:15.069 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/32 file after the snapshot 2020-04-02T23:49:15.072 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/33 file after the snapshot 2020-04-02T23:49:15.074 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/34 file after the snapshot 2020-04-02T23:49:15.076 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/35 file after the snapshot 2020-04-02T23:49:15.078 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/36 file after the snapshot 2020-04-02T23:49:15.103 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/37 file after the snapshot 2020-04-02T23:49:15.413 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/38 file after the snapshot 2020-04-02T23:49:15.415 INFO:tasks.workunit.client.0.smithi082.stdout: create 295/39 file after the snapshot 2020-04-02T23:49:15.417 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/.snap/snap-subdir-test 2020-04-02T23:49:15.696 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:15.718 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:15.873 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.871+0000 7f27e16af700 1 Processor -- start 2020-04-02T23:49:15.873 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.871+0000 7f27e16af700 1 -- start start 2020-04-02T23:49:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27e16af700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27dc067280 0x7f27dc09f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27e16af700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f27dc09f610 0x7f27dc1436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27e16af700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc0a7ab0 con 0x7f27dc05b390 2020-04-02T23:49:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27e16af700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc066b40 con 0x7f27dc067280 2020-04-02T23:49:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27e16af700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc0a63c0 con 0x7f27dc09f610 2020-04-02T23:49:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27db7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f27dc09f610 0x7f27dc1436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27db7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f27dc09f610 0x7f27dc1436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55638/0 (socket says 172.21.15.82:55638) 2020-04-02T23:49:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27daffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f27dc05b390 0x7f27dc13c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55688/0 (socket says 172.21.15.82:55688) 2020-04-02T23:49:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27db7fe700 1 -- 172.21.15.82:0/3925088259 learned_addr learned my addr 172.21.15.82:0/3925088259 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27da7fc700 1 --2- 172.21.15.82:0/3925088259 >> v2:172.21.15.50:3300/0 conn(0x7f27dc067280 0x7f27dc09f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27db7fe700 1 -- 172.21.15.82:0/3925088259 >> v2:172.21.15.50:3300/0 conn(0x7f27dc067280 msgr2=0x7f27dc09f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27db7fe700 1 --2- 172.21.15.82:0/3925088259 >> v2:172.21.15.50:3300/0 conn(0x7f27dc067280 0x7f27dc09f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27db7fe700 1 -- 172.21.15.82:0/3925088259 >> v1:172.21.15.82:6789/0 conn(0x7f27dc05b390 legacy=0x7f27dc13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27db7fe700 1 -- 172.21.15.82:0/3925088259 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0a25d0 con 0x7f27dc09f610 2020-04-02T23:49:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.872+0000 7f27d9ffb700 1 -- 172.21.15.82:0/3925088259 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245323808 0 0) 0x7f27dc0a7ab0 con 0x7f27dc05b390 2020-04-02T23:49:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27db7fe700 1 --2- 172.21.15.82:0/3925088259 >> v2:172.21.15.82:3300/0 conn(0x7f27dc09f610 0x7f27dc1436c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27d40032b0 tx=0x7f27d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27db7fe700 1 --2- 172.21.15.82:0/3925088259 >> v2:172.21.15.82:3300/0 conn(0x7f27dc09f610 0x7f27dc1436c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27d40032b0 tx=0x7f27d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27db7fe700 1 --2- 172.21.15.82:0/3925088259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27dc09f610 0x7f27dc1436c0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f27d40032b0 tx=0x7f27d4007dc0).ready entity=mon.1 client_cookie=fb7ffc393114293c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27db7fe700 1 --2- 172.21.15.82:0/3925088259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27dc09f610 0x7f27dc1436c0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27d40032b0 tx=0x7f27d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27d9ffb700 1 -- 172.21.15.82:0/3925088259 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d40110c0 con 0x7f27dc09f610 2020-04-02T23:49:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27db7fe700 1 --2- 172.21.15.82:0/3925088259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27dc09f610 0x7f27dc1436c0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27d40032b0 tx=0x7f27d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27d9ffb700 1 -- 172.21.15.82:0/3925088259 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4011220 con 0x7f27dc09f610 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27db7fe700 1 --2- 172.21.15.82:0/3925088259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27dc09f610 0x7f27dc1436c0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27d40032b0 tx=0x7f27d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 -- 172.21.15.82:0/3925088259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27dc09f610 msgr2=0x7f27dc1436c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27d9ffb700 1 -- 172.21.15.82:0/3925088259 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d40115c0 con 0x7f27dc09f610 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 --2- 172.21.15.82:0/3925088259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27dc09f610 0x7f27dc1436c0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f27d40032b0 tx=0x7f27d4007dc0).stop 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 -- 172.21.15.82:0/3925088259 shutdown_connections 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 --2- 172.21.15.82:0/3925088259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27dc09f610 0x7f27dc1436c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 --2- 172.21.15.82:0/3925088259 >> v2:172.21.15.50:3300/0 conn(0x7f27dc067280 0x7f27dc09f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 -- 172.21.15.82:0/3925088259 >> 172.21.15.82:0/3925088259 conn(0x7f27dc0614c0 msgr2=0x7f27dc0ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 -- 172.21.15.82:0/3925088259 shutdown_connections 2020-04-02T23:49:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.873+0000 7f27e16af700 1 -- 172.21.15.82:0/3925088259 wait complete. 2020-04-02T23:49:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.874+0000 7f27e16af700 1 Processor -- start 2020-04-02T23:49:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.874+0000 7f27e16af700 1 -- start start 2020-04-02T23:49:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27e16af700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27dc05b390 0x7f27dc13b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27e16af700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27e16af700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc0a23a0 con 0x7f27dc09f610 2020-04-02T23:49:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27e16af700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc09bd70 con 0x7f27dc05b390 2020-04-02T23:49:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27e16af700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc09d1c0 con 0x7f27dc067280 2020-04-02T23:49:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27daffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27dc05b390 0x7f27dc13b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27daffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27dc05b390 0x7f27dc13b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.82:52224/0 (socket says 172.21.15.82:52224) 2020-04-02T23:49:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27da7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.875+0000 7f27daffd700 1 -- 172.21.15.82:0/983386580 learned_addr learned my addr 172.21.15.82:0/983386580 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 -- 172.21.15.82:0/983386580 >> v2:172.21.15.50:3300/0 conn(0x7f27dc05b390 msgr2=0x7f27dc13b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> v2:172.21.15.50:3300/0 conn(0x7f27dc05b390 0x7f27dc13b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 -- 172.21.15.82:0/983386580 >> v1:172.21.15.50:6789/0 conn(0x7f27dc09f610 legacy=0x7f27dc136490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 -- 172.21.15.82:0/983386580 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc09f120 con 0x7f27dc067280 2020-04-02T23:49:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27daffd700 1 --2- 172.21.15.82:0/983386580 >> v2:172.21.15.50:3300/0 conn(0x7f27dc05b390 0x7f27dc13b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:49:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27cbfff700 1 -- 172.21.15.82:0/983386580 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27cc005e90 con 0x7f27dc067280 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27cbfff700 1 -- 172.21.15.82:0/983386580 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc007160 con 0x7f27dc067280 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc0a4a10 con 0x7f27dc067280 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27cbfff700 1 -- 172.21.15.82:0/983386580 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27cc007540 con 0x7f27dc067280 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.876+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc0a4f50 con 0x7f27dc067280 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.877+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.877+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27dc0a50e0 con 0x7f27dc067280 2020-04-02T23:49:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.877+0000 7f27cbfff700 1 -- 172.21.15.82:0/983386580 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f27cc00e270 con 0x7f27dc067280 2020-04-02T23:49:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.877+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.877+0000 7f27cbfff700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 0x7f27b804f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.877+0000 7f27cbfff700 1 -- 172.21.15.82:0/983386580 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f27cc0613b0 con 0x7f27dc067280 2020-04-02T23:49:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.877+0000 7f27daffd700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 0x7f27b804f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.878+0000 7f27daffd700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 0x7f27b804f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27d0000e90 tx=0x7f27d0001420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.878+0000 7f27daffd700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 0x7f27b804f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27d0000e90 tx=0x7f27d0001420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.878+0000 7f27daffd700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 0x7f27b804f9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f27d0000e90 tx=0x7f27d0001420).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.881+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:15.881+0000 7f27cbfff700 1 -- 172.21.15.82:0/983386580 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f27cc03ca30 con 0x7f27dc067280 2020-04-02T23:49:16.003 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/30 file after the snapshot 2020-04-02T23:49:16.034 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/31 file after the snapshot 2020-04-02T23:49:16.036 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/32 file after the snapshot 2020-04-02T23:49:16.038 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/33 file after the snapshot 2020-04-02T23:49:16.039 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/34 file after the snapshot 2020-04-02T23:49:16.041 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/35 file after the snapshot 2020-04-02T23:49:16.043 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/36 file after the snapshot 2020-04-02T23:49:16.045 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/37 file after the snapshot 2020-04-02T23:49:16.046 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/38 file after the snapshot 2020-04-02T23:49:16.048 INFO:tasks.workunit.client.0.smithi082.stdout: create 296/39 file after the snapshot 2020-04-02T23:49:16.051 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/.snap/snap-subdir-test 2020-04-02T23:49:16.081 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/30 file after the snapshot 2020-04-02T23:49:16.083 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/31 file after the snapshot 2020-04-02T23:49:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.081+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27dc056c50 con 0x7f27dc067280 2020-04-02T23:49:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.082+0000 7f27da7fc700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.082+0000 7f27cbfff700 1 -- 172.21.15.82:0/983386580 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f27cc00a870 con 0x7f27dc067280 2020-04-02T23:49:16.084 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:16.084 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:16.085 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/32 file after the snapshot 2020-04-02T23:49:16.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 msgr2=0x7f27b804f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 0x7f27b804f9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f27d0000e90 tx=0x7f27d0001420).stop 2020-04-02T23:49:16.086 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 msgr2=0x7f27dc09cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010b90).stop 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 shutdown_connections 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f27b804d530 0x7f27b804f9f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 --2- 172.21.15.82:0/983386580 >> v2:172.21.15.50:3300/0 conn(0x7f27dc05b390 0x7f27dc13b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 --2- 172.21.15.82:0/983386580 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27dc067280 0x7f27dc09cd60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 >> 172.21.15.82:0/983386580 conn(0x7f27dc0614c0 msgr2=0x7f27dc0a1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 shutdown_connections 2020-04-02T23:49:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.084+0000 7f27e16af700 1 -- 172.21.15.82:0/983386580 wait complete. 2020-04-02T23:49:16.088 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/33 file after the snapshot 2020-04-02T23:49:16.088 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:16.088 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/34 file after the snapshot 2020-04-02T23:49:16.090 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/35 file after the snapshot 2020-04-02T23:49:16.093 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/36 file after the snapshot 2020-04-02T23:49:16.094 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/37 file after the snapshot 2020-04-02T23:49:16.097 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/38 file after the snapshot 2020-04-02T23:49:16.100 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=0) 2020-04-02T23:49:16.100 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-02T23:49:16.100 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:49:16.100 INFO:tasks.workunit.client.0.smithi082.stdout: create 297/39 file after the snapshot 2020-04-02T23:49:16.109 INFO:tasks.ceph.mds.a:Stopped 2020-04-02T23:49:16.109 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:16.163 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.308+0000 7faca2607700 1 Processor -- start 2020-04-02T23:49:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.308+0000 7faca2607700 1 -- start start 2020-04-02T23:49:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.308+0000 7faca2607700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.308+0000 7faca2607700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.308+0000 7faca2607700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c0a9f40 con 0x7fac9c0a6ba0 2020-04-02T23:49:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.308+0000 7faca2607700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c0aa180 con 0x7fac9c0ac740 2020-04-02T23:49:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.308+0000 7faca2607700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0aa420 con 0x7fac9c1393e0 2020-04-02T23:49:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1605700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.82:51370/0 (socket says 172.21.15.82:51370) 2020-04-02T23:49:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 -- 172.21.15.82:0/2245394824 learned_addr learned my addr 172.21.15.82:0/2245394824 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 -- 172.21.15.82:0/2245394824 >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 msgr2=0x7fac9c0a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 --2- 172.21.15.82:0/2245394824 >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 -- 172.21.15.82:0/2245394824 >> v1:172.21.15.50:6789/0 conn(0x7fac9c0a6ba0 legacy=0x7fac9c138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 -- 172.21.15.82:0/2245394824 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0aa6c0 con 0x7fac9c1393e0 2020-04-02T23:49:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1605700 1 --2- 172.21.15.82:0/2245394824 >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:49:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac940032b0 tx=0x7fac94007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac940032b0 tx=0x7fac94007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.309+0000 7faca1e06700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fac940032b0 tx=0x7fac94007dc0).ready entity=mon.2 client_cookie=3626c2087c7f2acd server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca1e06700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fac940032b0 tx=0x7fac94007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca1e06700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fac940032b0 tx=0x7fac94007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca1e06700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fac940032b0 tx=0x7fac94007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7fac8ffff700 1 -- 172.21.15.82:0/2245394824 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac9400a160 con 0x7fac9c1393e0 2020-04-02T23:49:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7fac8ffff700 1 -- 172.21.15.82:0/2245394824 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400a2c0 con 0x7fac9c1393e0 2020-04-02T23:49:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7fac8ffff700 1 -- 172.21.15.82:0/2245394824 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac9400a6e0 con 0x7fac9c1393e0 2020-04-02T23:49:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 -- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 msgr2=0x7fac9c066c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fac940032b0 tx=0x7fac94007dc0).stop 2020-04-02T23:49:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 -- 172.21.15.82:0/2245394824 shutdown_connections 2020-04-02T23:49:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 --2- 172.21.15.82:0/2245394824 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac9c1393e0 0x7fac9c066c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 --2- 172.21.15.82:0/2245394824 >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 -- 172.21.15.82:0/2245394824 >> 172.21.15.82:0/2245394824 conn(0x7fac9c0afc00 msgr2=0x7fac9c0abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 -- 172.21.15.82:0/2245394824 shutdown_connections 2020-04-02T23:49:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.310+0000 7faca2607700 1 -- 172.21.15.82:0/2245394824 wait complete. 2020-04-02T23:49:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.311+0000 7faca2607700 1 Processor -- start 2020-04-02T23:49:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.311+0000 7faca2607700 1 -- start start 2020-04-02T23:49:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca2607700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca2607700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c0a4d90 con 0x7fac9c0a6ba0 2020-04-02T23:49:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca2607700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c135ad0 con 0x7fac9c1393e0 2020-04-02T23:49:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca2607700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c13a4a0 con 0x7fac9c0ac740 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca1e06700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fac9c1393e0 0x7fac9c132460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55720/0 (socket says 172.21.15.82:55720) 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca1e06700 1 -- 172.21.15.82:0/4149731445 learned_addr learned my addr 172.21.15.82:0/4149731445 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356690381 0 0) 0x7fac9c135ad0 con 0x7fac9c1393e0 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac7c002fe0 con 0x7fac9c1393e0 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3518826720 0 0) 0x7fac7c002fe0 con 0x7fac9c1393e0 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca0e04700 1 -- 172.21.15.82:0/4149731445 >> v1:172.21.15.82:6789/0 conn(0x7fac9c1393e0 legacy=0x7fac9c132460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca0e04700 1 -- 172.21.15.82:0/4149731445 >> v1:172.21.15.50:6789/0 conn(0x7fac9c0a6ba0 legacy=0x7fac9c0a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca0e04700 1 -- 172.21.15.82:0/4149731445 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c13a690 con 0x7fac9c0ac740 2020-04-02T23:49:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.312+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> v2:172.21.15.50:3300/0 conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac90001ea0 con 0x7fac9c0ac740 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000cb00 con 0x7fac9c0ac740 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c13a930 con 0x7fac9c0ac740 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac9400ad60 con 0x7fac9c0ac740 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c0a5a80 con 0x7fac9c0ac740 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.313+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.314+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fac900064e0 con 0x7fac9c0ac740 2020-04-02T23:49:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.314+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.314+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c056c50 con 0x7fac9c0ac740 2020-04-02T23:49:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.314+0000 7fac8e7fc700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 0x7fac7c04fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.314+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fac900604a0 con 0x7fac9c0ac740 2020-04-02T23:49:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.314+0000 7faca1605700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 0x7fac7c04fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:16.326 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.315+0000 7faca1605700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 0x7fac7c04fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac98002ef0 tx=0x7fac980027c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.326 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.315+0000 7faca1605700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 0x7fac7c04fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac98002ef0 tx=0x7fac980027c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.326 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.315+0000 7faca1605700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 0x7fac7c04fd50 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fac98002ef0 tx=0x7fac980027c0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:16.326 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.318+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.318+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fac9003bb40 con 0x7fac9c0ac740 2020-04-02T23:49:16.502 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.500+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac9c0a9f40 con 0x7fac9c0ac740 2020-04-02T23:49:16.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.501+0000 7faca0e04700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:16.503 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.501+0000 7fac8e7fc700 1 -- 172.21.15.82:0/4149731445 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fac9c0a9f40 con 0x7fac9c0ac740 2020-04-02T23:49:16.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:16.504 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.502+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 msgr2=0x7fac7c04fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.502+0000 7faca2607700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 0x7fac7c04fd50 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fac98002ef0 tx=0x7fac980027c0).stop 2020-04-02T23:49:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.502+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 msgr2=0x7fac9c0a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:16.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.502+0000 7faca2607700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fac98007720 tx=0x7fac900108e0).stop 2020-04-02T23:49:16.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.503+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 shutdown_connections 2020-04-02T23:49:16.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.503+0000 7faca2607700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fac7c04d890 0x7fac7c04fd50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:16.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.503+0000 7faca2607700 1 --2- 172.21.15.82:0/4149731445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c0ac740 0x7fac9c0a4930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:16.506 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.503+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 >> 172.21.15.82:0/4149731445 conn(0x7fac9c0afc00 msgr2=0x7fac9c068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:16.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.503+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 shutdown_connections 2020-04-02T23:49:16.507 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:16.503+0000 7faca2607700 1 -- 172.21.15.82:0/4149731445 wait complete. 2020-04-02T23:49:16.507 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:16.515 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:18.516 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:18.533 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.687+0000 7fb649f77700 1 Processor -- start 2020-04-02T23:49:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.687+0000 7fb649f77700 1 -- start start 2020-04-02T23:49:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb649f77700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6440a5150 0x7fb6441360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb649f77700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb644136530 0x7fb644140220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb649f77700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440a3d50 con 0x7fb6440a29a0 2020-04-02T23:49:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb649f77700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440a4110 con 0x7fb6440a5150 2020-04-02T23:49:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb649f77700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb644066bf0 con 0x7fb644136530 2020-04-02T23:49:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb644136530 0x7fb644140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb644136530 0x7fb644140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55682/0 (socket says 172.21.15.82:55682) 2020-04-02T23:49:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 -- 172.21.15.82:0/608979334 learned_addr learned my addr 172.21.15.82:0/608979334 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb642ffd700 1 --2- 172.21.15.82:0/608979334 >> v2:172.21.15.50:3300/0 conn(0x7fb6440a5150 0x7fb6441360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 -- 172.21.15.82:0/608979334 >> v2:172.21.15.50:3300/0 conn(0x7fb6440a5150 msgr2=0x7fb6441360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- 172.21.15.82:0/608979334 >> v2:172.21.15.50:3300/0 conn(0x7fb6440a5150 0x7fb6441360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 -- 172.21.15.82:0/608979334 >> v1:172.21.15.50:6789/0 conn(0x7fb6440a29a0 legacy=0x7fb6440a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 -- 172.21.15.82:0/608979334 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440a4300 con 0x7fb644136530 2020-04-02T23:49:18.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb642ffd700 1 --2- 172.21.15.82:0/608979334 >> v2:172.21.15.50:3300/0 conn(0x7fb6440a5150 0x7fb6441360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:49:18.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- 172.21.15.82:0/608979334 >> v2:172.21.15.82:3300/0 conn(0x7fb644136530 0x7fb644140220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb64405f4e0 tx=0x7fb63c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.704 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- 172.21.15.82:0/608979334 >> v2:172.21.15.82:3300/0 conn(0x7fb644136530 0x7fb644140220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb64405f4e0 tx=0x7fb63c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- 172.21.15.82:0/608979334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644136530 0x7fb644140220 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fb64405f4e0 tx=0x7fb63c007dc0).ready entity=mon.1 client_cookie=4dd1dc1c624d8c29 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:18.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- 172.21.15.82:0/608979334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644136530 0x7fb644140220 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fb64405f4e0 tx=0x7fb63c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb6427fc700 1 -- 172.21.15.82:0/608979334 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb63c00a160 con 0x7fb644136530 2020-04-02T23:49:18.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- 172.21.15.82:0/608979334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644136530 0x7fb644140220 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fb64405f4e0 tx=0x7fb63c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.705 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb643fff700 1 --2- 172.21.15.82:0/608979334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644136530 0x7fb644140220 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fb64405f4e0 tx=0x7fb63c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb6427fc700 1 -- 172.21.15.82:0/608979334 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00a2c0 con 0x7fb644136530 2020-04-02T23:49:18.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb6427fc700 1 -- 172.21.15.82:0/608979334 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb63c00a6a0 con 0x7fb644136530 2020-04-02T23:49:18.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb649f77700 1 -- 172.21.15.82:0/608979334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644136530 msgr2=0x7fb644140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:18.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.688+0000 7fb649f77700 1 --2- 172.21.15.82:0/608979334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644136530 0x7fb644140220 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fb64405f4e0 tx=0x7fb63c007dc0).stop 2020-04-02T23:49:18.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.689+0000 7fb649f77700 1 -- 172.21.15.82:0/608979334 shutdown_connections 2020-04-02T23:49:18.706 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.689+0000 7fb649f77700 1 --2- 172.21.15.82:0/608979334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644136530 0x7fb644140220 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:18.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.689+0000 7fb649f77700 1 --2- 172.21.15.82:0/608979334 >> v2:172.21.15.50:3300/0 conn(0x7fb6440a5150 0x7fb6441360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:18.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.689+0000 7fb649f77700 1 -- 172.21.15.82:0/608979334 >> 172.21.15.82:0/608979334 conn(0x7fb64409de60 msgr2=0x7fb64409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:18.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.689+0000 7fb649f77700 1 -- 172.21.15.82:0/608979334 shutdown_connections 2020-04-02T23:49:18.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.689+0000 7fb649f77700 1 -- 172.21.15.82:0/608979334 wait complete. 2020-04-02T23:49:18.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.690+0000 7fb649f77700 1 Processor -- start 2020-04-02T23:49:18.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.690+0000 7fb649f77700 1 -- start start 2020-04-02T23:49:18.707 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb649f77700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6440a5150 0x7fb6440647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:18.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb649f77700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb644136530 0x7fb644146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:18.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb649f77700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb644066e20 con 0x7fb6440a29a0 2020-04-02T23:49:18.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb649f77700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb644062f50 con 0x7fb644136530 2020-04-02T23:49:18.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb649f77700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb644062a10 con 0x7fb6440a5150 2020-04-02T23:49:18.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6440a5150 0x7fb6440647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:18.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6440a5150 0x7fb6440647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55686/0 (socket says 172.21.15.82:55686) 2020-04-02T23:49:18.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 -- 172.21.15.82:0/164795434 learned_addr learned my addr 172.21.15.82:0/164795434 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:18.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb643fff700 1 --2- 172.21.15.82:0/164795434 >> v2:172.21.15.50:3300/0 conn(0x7fb644136530 0x7fb644146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:18.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 -- 172.21.15.82:0/164795434 >> v2:172.21.15.50:3300/0 conn(0x7fb644136530 msgr2=0x7fb644146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:18.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> v2:172.21.15.50:3300/0 conn(0x7fb644136530 0x7fb644146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:18.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 -- 172.21.15.82:0/164795434 >> v1:172.21.15.50:6789/0 conn(0x7fb6440a29a0 legacy=0x7fb6440619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:18.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 -- 172.21.15.82:0/164795434 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644062cb0 con 0x7fb6440a5150 2020-04-02T23:49:18.709 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> v2:172.21.15.82:3300/0 conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> v2:172.21.15.82:3300/0 conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:18.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb640ff9700 1 -- 172.21.15.82:0/164795434 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb638007160 con 0x7fb6440a5150 2020-04-02T23:49:18.710 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb640ff9700 1 -- 172.21.15.82:0/164795434 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6380072c0 con 0x7fb6440a5150 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb644138e10 con 0x7fb6440a5150 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb640ff9700 1 -- 172.21.15.82:0/164795434 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6380059c0 con 0x7fb6440a5150 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.691+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440620e0 con 0x7fb6440a5150 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.692+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.692+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644056c50 con 0x7fb6440a5150 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.692+0000 7fb640ff9700 1 -- 172.21.15.82:0/164795434 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb638005c30 con 0x7fb6440a5150 2020-04-02T23:49:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.692+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.693+0000 7fb640ff9700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 0x7fb62404fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.693+0000 7fb640ff9700 1 -- 172.21.15.82:0/164795434 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fb638060e20 con 0x7fb6440a5150 2020-04-02T23:49:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.693+0000 7fb6437fe700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 0x7fb62404fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.693+0000 7fb6437fe700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 0x7fb62404fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb644064170 tx=0x7fb634007b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.693+0000 7fb6437fe700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 0x7fb62404fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb644064170 tx=0x7fb634007b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.693+0000 7fb6437fe700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 0x7fb62404fa80 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fb644064170 tx=0x7fb634007b60).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:18.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.696+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.696+0000 7fb640ff9700 1 -- 172.21.15.82:0/164795434 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb63803c580 con 0x7fb6440a5150 2020-04-02T23:49:18.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.876+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb64405c5d0 con 0x7fb6440a5150 2020-04-02T23:49:18.878 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.876+0000 7fb642ffd700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:18.879 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.876+0000 7fb640ff9700 1 -- 172.21.15.82:0/164795434 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fb63803fba0 con 0x7fb6440a5150 2020-04-02T23:49:18.879 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:18.879 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:18.880 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 msgr2=0x7fb62404fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:18.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 0x7fb62404fa80 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fb644064170 tx=0x7fb634007b60).stop 2020-04-02T23:49:18.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 msgr2=0x7fb6440647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:18.881 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fb638002f30 tx=0x7fb638010ac0).stop 2020-04-02T23:49:18.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 shutdown_connections 2020-04-02T23:49:18.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb62404d5c0 0x7fb62404fa80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:18.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 --2- 172.21.15.82:0/164795434 >> v2:172.21.15.50:3300/0 conn(0x7fb644136530 0x7fb644146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:18.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.877+0000 7fb649f77700 1 --2- 172.21.15.82:0/164795434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6440a5150 0x7fb6440647a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:18.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.878+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 >> 172.21.15.82:0/164795434 conn(0x7fb64409de60 msgr2=0x7fb644068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:18.882 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.878+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 shutdown_connections 2020-04-02T23:49:18.883 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:18.878+0000 7fb649f77700 1 -- 172.21.15.82:0/164795434 wait complete. 2020-04-02T23:49:18.883 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:18.890 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:20.892 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:20.909 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.063+0000 7fb17b31c700 1 Processor -- start 2020-04-02T23:49:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.063+0000 7fb17b31c700 1 -- start start 2020-04-02T23:49:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb17b31c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb1740aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb17b31c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb1740a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb17b31c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1740a5820 con 0x7fb1740a4b70 2020-04-02T23:49:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb17b31c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740a4130 con 0x7fb174136870 2020-04-02T23:49:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb17b31c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740a43d0 con 0x7fb1740a2ab0 2020-04-02T23:49:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb1740a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb1740a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55696/0 (socket says 172.21.15.82:55696) 2020-04-02T23:49:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 -- 172.21.15.82:0/3993461591 learned_addr learned my addr 172.21.15.82:0/3993461591 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1790b8700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb1740aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 -- 172.21.15.82:0/3993461591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 msgr2=0x7fb1740aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb1740aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 -- 172.21.15.82:0/3993461591 >> v1:172.21.15.50:6789/0 conn(0x7fb1740a4b70 legacy=0x7fb174136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 -- 172.21.15.82:0/3993461591 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740a4670 con 0x7fb174136870 2020-04-02T23:49:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1790b8700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb1740aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:49:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 --2- 172.21.15.82:0/3993461591 >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb1740a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 --2- 172.21.15.82:0/3993461591 >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb1740a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.064+0000 7fb1798b9700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb1740a4ff0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).ready entity=mon.1 client_cookie=58772bd70de3127d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb1798b9700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb1740a4ff0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb167fff700 1 -- 172.21.15.82:0/3993461591 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb16c00a160 con 0x7fb174136870 2020-04-02T23:49:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb1798b9700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb1740a4ff0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb1798b9700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb1740a4ff0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb167fff700 1 -- 172.21.15.82:0/3993461591 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00a2c0 con 0x7fb174136870 2020-04-02T23:49:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb167fff700 1 -- 172.21.15.82:0/3993461591 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb16c00a6e0 con 0x7fb174136870 2020-04-02T23:49:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 -- 172.21.15.82:0/3993461591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 msgr2=0x7fb1740a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb1740a4ff0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).stop 2020-04-02T23:49:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 -- 172.21.15.82:0/3993461591 shutdown_connections 2020-04-02T23:49:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb1740aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 --2- 172.21.15.82:0/3993461591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb1740a4ff0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 -- 172.21.15.82:0/3993461591 >> 172.21.15.82:0/3993461591 conn(0x7fb17409de60 msgr2=0x7fb17409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 -- 172.21.15.82:0/3993461591 shutdown_connections 2020-04-02T23:49:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.065+0000 7fb17b31c700 1 -- 172.21.15.82:0/3993461591 wait complete. 2020-04-02T23:49:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.066+0000 7fb17b31c700 1 Processor -- start 2020-04-02T23:49:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.066+0000 7fb17b31c700 1 -- start start 2020-04-02T23:49:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb17b31c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb174061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb17b31c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb17412cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb17b31c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1740a0d40 con 0x7fb1740a4b70 2020-04-02T23:49:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb17b31c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740624c0 con 0x7fb174136870 2020-04-02T23:49:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb17b31c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740a0fe0 con 0x7fb1740a2ab0 2020-04-02T23:49:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb17412cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb17412cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55706/0 (socket says 172.21.15.82:55706) 2020-04-02T23:49:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 -- 172.21.15.82:0/2354076798 learned_addr learned my addr 172.21.15.82:0/2354076798 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1790b8700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb174061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 -- 172.21.15.82:0/2354076798 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 msgr2=0x7fb174061650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb174061650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 -- 172.21.15.82:0/2354076798 >> v1:172.21.15.50:6789/0 conn(0x7fb1740a4b70 legacy=0x7fb17409ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 -- 172.21.15.82:0/2354076798 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740a1280 con 0x7fb174136870 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> v2:172.21.15.82:3300/0 conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1667fc700 1 -- 172.21.15.82:0/2354076798 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb16c010640 con 0x7fb174136870 2020-04-02T23:49:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1667fc700 1 -- 172.21.15.82:0/2354076798 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00a740 con 0x7fb174136870 2020-04-02T23:49:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb1667fc700 1 -- 172.21.15.82:0/2354076798 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb16c011e20 con 0x7fb174136870 2020-04-02T23:49:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.067+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb174061ab0 con 0x7fb174136870 2020-04-02T23:49:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.068+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1740a1720 con 0x7fb174136870 2020-04-02T23:49:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.068+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1667fc700 1 -- 172.21.15.82:0/2354076798 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb16c00f570 con 0x7fb174136870 2020-04-02T23:49:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb174056c50 con 0x7fb174136870 2020-04-02T23:49:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1667fc700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 0x7fb15404fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1667fc700 1 -- 172.21.15.82:0/2354076798 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fb16c061ce0 con 0x7fb174136870 2020-04-02T23:49:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1790b8700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 0x7fb15404fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1790b8700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 0x7fb15404fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb168002f30 tx=0x7fb168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1790b8700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 0x7fb15404fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb168002f30 tx=0x7fb168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.069+0000 7fb1790b8700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 0x7fb15404fa20 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fb168002f30 tx=0x7fb168007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.072+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.072+0000 7fb1667fc700 1 -- 172.21.15.82:0/2354076798 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb16c03d500 con 0x7fb174136870 2020-04-02T23:49:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.260+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb17405d150 con 0x7fb174136870 2020-04-02T23:49:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.260+0000 7fb1798b9700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.260+0000 7fb1667fc700 1 -- 172.21.15.82:0/2354076798 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fb16c040b20 con 0x7fb174136870 2020-04-02T23:49:21.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:21.263 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 msgr2=0x7fb15404fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 0x7fb15404fa20 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fb168002f30 tx=0x7fb168007a40).stop 2020-04-02T23:49:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 msgr2=0x7fb17412cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fb16c0032b0 tx=0x7fb16c007dc0).stop 2020-04-02T23:49:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 shutdown_connections 2020-04-02T23:49:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb15404d560 0x7fb15404fa20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1740a2ab0 0x7fb174061650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 --2- 172.21.15.82:0/2354076798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb174136870 0x7fb17412cce0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 >> 172.21.15.82:0/2354076798 conn(0x7fb17409de60 msgr2=0x7fb174135780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 shutdown_connections 2020-04-02T23:49:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:21.262+0000 7fb17b31c700 1 -- 172.21.15.82:0/2354076798 wait complete. 2020-04-02T23:49:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:21.274 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:23.275 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:23.291 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.447+0000 7fdd68691700 1 Processor -- start 2020-04-02T23:49:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.447+0000 7fdd68691700 1 -- start start 2020-04-02T23:49:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd68691700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd600ab200 0x7fdd60136e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd68691700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd60135d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd68691700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600a4be0 con 0x7fdd601361d0 2020-04-02T23:49:23.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd68691700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd600a4180 con 0x7fdd600a4570 2020-04-02T23:49:23.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd68691700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600a49d0 con 0x7fdd600ab200 2020-04-02T23:49:23.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd66c2e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdd601361d0 0x7fdd60136610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55762/0 (socket says 172.21.15.82:55762) 2020-04-02T23:49:23.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd66c2e700 1 -- 172.21.15.82:0/3902299901 learned_addr learned my addr 172.21.15.82:0/3902299901 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:23.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd60135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:23.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd6642d700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd600ab200 0x7fdd60136e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:23.453 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd6542b700 1 -- 172.21.15.82:0/3902299901 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928945501 0 0) 0x7fdd600a4be0 con 0x7fdd601361d0 2020-04-02T23:49:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd6542b700 1 -- 172.21.15.82:0/3902299901 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd48003230 con 0x7fdd601361d0 2020-04-02T23:49:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd65c2c700 1 -- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd600ab200 msgr2=0x7fdd60136e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd600ab200 0x7fdd60136e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd65c2c700 1 -- 172.21.15.82:0/3902299901 >> v1:172.21.15.82:6789/0 conn(0x7fdd601361d0 legacy=0x7fdd60136610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd6542b700 1 -- 172.21.15.82:0/3902299901 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2944582744 0 0) 0x7fdd48003230 con 0x7fdd601361d0 2020-04-02T23:49:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd65c2c700 1 -- 172.21.15.82:0/3902299901 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600a3d50 con 0x7fdd600a4570 2020-04-02T23:49:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd6642d700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd600ab200 0x7fdd60136e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:49:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd60135d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.448+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd60135d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600a4570 0x7fdd60135d70 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).ready entity=mon.0 client_cookie=9cd0c931ab512ada server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600a4570 0x7fdd60135d70 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd6542b700 1 -- 172.21.15.82:0/3902299901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd58001a50 con 0x7fdd600a4570 2020-04-02T23:49:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600a4570 0x7fdd60135d70 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd6542b700 1 -- 172.21.15.82:0/3902299901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50008b40 con 0x7fdd600a4570 2020-04-02T23:49:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600a4570 0x7fdd60135d70 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd6542b700 1 -- 172.21.15.82:0/3902299901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd50008ea0 con 0x7fdd600a4570 2020-04-02T23:49:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 -- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600a4570 msgr2=0x7fdd60135d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600a4570 0x7fdd60135d70 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).stop 2020-04-02T23:49:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 -- 172.21.15.82:0/3902299901 shutdown_connections 2020-04-02T23:49:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd600ab200 0x7fdd60136e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 --2- 172.21.15.82:0/3902299901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600a4570 0x7fdd60135d70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 -- 172.21.15.82:0/3902299901 >> 172.21.15.82:0/3902299901 conn(0x7fdd6009de60 msgr2=0x7fdd6009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 -- 172.21.15.82:0/3902299901 shutdown_connections 2020-04-02T23:49:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.449+0000 7fdd68691700 1 -- 172.21.15.82:0/3902299901 wait complete. 2020-04-02T23:49:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.450+0000 7fdd68691700 1 Processor -- start 2020-04-02T23:49:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.450+0000 7fdd68691700 1 -- start start 2020-04-02T23:49:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd68691700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd6012d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd68691700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd600ab200 0x7fdd6012b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd68691700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6012f980 con 0x7fdd601361d0 2020-04-02T23:49:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd68691700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6012e180 con 0x7fdd600a4570 2020-04-02T23:49:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd68691700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6012fbb0 con 0x7fdd600ab200 2020-04-02T23:49:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd600ab200 0x7fdd6012b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd600ab200 0x7fdd6012b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55720/0 (socket says 172.21.15.82:55720) 2020-04-02T23:49:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 -- 172.21.15.82:0/4239841349 learned_addr learned my addr 172.21.15.82:0/4239841349 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd6642d700 1 --2- 172.21.15.82:0/4239841349 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd6012d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 -- 172.21.15.82:0/4239841349 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 msgr2=0x7fdd6012d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd6012d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 -- 172.21.15.82:0/4239841349 >> v1:172.21.15.82:6789/0 conn(0x7fdd601361d0 legacy=0x7fdd6012c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 -- 172.21.15.82:0/4239841349 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6012fe50 con 0x7fdd600ab200 2020-04-02T23:49:23.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd6642d700 1 --2- 172.21.15.82:0/4239841349 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd6012d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:49:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> v2:172.21.15.82:3300/0 conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> v2:172.21.15.82:3300/0 conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:23.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd4f7fe700 1 -- 172.21.15.82:0/4239841349 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd50007350 con 0x7fdd600ab200 2020-04-02T23:49:23.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd4f7fe700 1 -- 172.21.15.82:0/4239841349 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd500074b0 con 0x7fdd600ab200 2020-04-02T23:49:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd4f7fe700 1 -- 172.21.15.82:0/4239841349 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd50011bc0 con 0x7fdd600ab200 2020-04-02T23:49:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.451+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd600a5f00 con 0x7fdd600ab200 2020-04-02T23:49:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.452+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6012cc00 con 0x7fdd600ab200 2020-04-02T23:49:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.452+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd4f7fe700 1 -- 172.21.15.82:0/4239841349 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdd50011d20 con 0x7fdd600ab200 2020-04-02T23:49:23.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6012ffe0 con 0x7fdd600ab200 2020-04-02T23:49:23.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd4f7fe700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 0x7fdd4004f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:23.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd4f7fe700 1 -- 172.21.15.82:0/4239841349 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fdd500614d0 con 0x7fdd600ab200 2020-04-02T23:49:23.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd6642d700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 0x7fdd4004f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:23.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd6642d700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 0x7fdd4004f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd5c002f30 tx=0x7fdd5c009370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.467 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd6642d700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 0x7fdd4004f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd5c002f30 tx=0x7fdd5c009370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.453+0000 7fdd6642d700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 0x7fdd4004f9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fdd5c002f30 tx=0x7fdd5c009370).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:23.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.456+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.468 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.456+0000 7fdd4f7fe700 1 -- 172.21.15.82:0/4239841349 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fdd5003ccf0 con 0x7fdd600ab200 2020-04-02T23:49:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.641+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd6012df70 con 0x7fdd600ab200 2020-04-02T23:49:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.641+0000 7fdd65c2c700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.641+0000 7fdd4f7fe700 1 -- 172.21.15.82:0/4239841349 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fdd50040310 con 0x7fdd600ab200 2020-04-02T23:49:23.643 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:23.644 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:23.644 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 msgr2=0x7fdd4004f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 0x7fdd4004f9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fdd5c002f30 tx=0x7fdd5c009370).stop 2020-04-02T23:49:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 msgr2=0x7fdd6012b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7fdd58001bf0 tx=0x7fdd50007a40).stop 2020-04-02T23:49:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 shutdown_connections 2020-04-02T23:49:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fdd4004d530 0x7fdd4004f9f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 --2- 172.21.15.82:0/4239841349 >> v2:172.21.15.50:3300/0 conn(0x7fdd600a4570 0x7fdd6012d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 --2- 172.21.15.82:0/4239841349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd600ab200 0x7fdd6012b350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 >> 172.21.15.82:0/4239841349 conn(0x7fdd6009de60 msgr2=0x7fdd601354f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 shutdown_connections 2020-04-02T23:49:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:23.642+0000 7fdd68691700 1 -- 172.21.15.82:0/4239841349 wait complete. 2020-04-02T23:49:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:23.655 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:25.538 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:49:25.556 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:25.598 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:25.615 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:25.655 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:25.672 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.822+0000 7fd2a347b700 1 Processor -- start 2020-04-02T23:49:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.822+0000 7fd2a347b700 1 -- start start 2020-04-02T23:49:25.832 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.822+0000 7fd2a347b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd29c136870 0x7fd29c0a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:25.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.822+0000 7fd2a347b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c0a5820 con 0x7fd29c0a4b70 2020-04-02T23:49:25.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a347b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c0a4130 con 0x7fd29c0a2ab0 2020-04-02T23:49:25.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a347b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c0a43d0 con 0x7fd29c136870 2020-04-02T23:49:25.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd29c136870 0x7fd29c0a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd29c136870 0x7fd29c0a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55730/0 (socket says 172.21.15.82:55730) 2020-04-02T23:49:25.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 -- 172.21.15.82:0/296462159 learned_addr learned my addr 172.21.15.82:0/296462159 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:25.833 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 -- 172.21.15.82:0/296462159 >> v1:172.21.15.82:6789/0 conn(0x7fd29c0a2ab0 legacy=0x7fd29c0aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 -- 172.21.15.82:0/296462159 >> v1:172.21.15.50:6789/0 conn(0x7fd29c0a4b70 legacy=0x7fd29c136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 -- 172.21.15.82:0/296462159 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0a4670 con 0x7fd29c136870 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 --2- 172.21.15.82:0/296462159 >> v2:172.21.15.82:3300/0 conn(0x7fd29c136870 0x7fd29c0a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd290002f30 tx=0x7fd290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 --2- 172.21.15.82:0/296462159 >> v2:172.21.15.82:3300/0 conn(0x7fd29c136870 0x7fd29c0a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd290002f30 tx=0x7fd290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 0x7fd29c0a4ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd290007a40).ready entity=mon.1 client_cookie=2427f6fee6f24973 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 -- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 msgr2=0x7fd29c0a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 -- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 msgr2=0x7fd29c0a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-04-02T23:49:25.834 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 0x7fd29c0a4ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd290007a40).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:49:25.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1a18700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 0x7fd29c0a4ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd290007a40).stop 2020-04-02T23:49:25.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd28ffff700 1 -- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 msgr2=0x7fd29c0a4ff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-04-02T23:49:25.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd28ffff700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 0x7fd29c0a4ff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:25.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd28ffff700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:25.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd28ffff700 1 --2- 172.21.15.82:0/296462159 >> v2:172.21.15.50:3300/0 conn(0x7fd284005c90 0x7fd284008150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:25.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd28ffff700 1 -- 172.21.15.82:0/296462159 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd284008780 con 0x7fd284005c90 2020-04-02T23:49:25.835 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd28ffff700 1 -- 172.21.15.82:0/296462159 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840088f0 con 0x7fd284003210 2020-04-02T23:49:25.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a0a16700 1 --2- 172.21.15.82:0/296462159 >> v2:172.21.15.50:3300/0 conn(0x7fd284005c90 0x7fd284008150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.823+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 -- 172.21.15.82:0/296462159 >> v2:172.21.15.50:3300/0 conn(0x7fd284005c90 msgr2=0x7fd284008150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:25.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> v2:172.21.15.50:3300/0 conn(0x7fd284005c90 0x7fd284008150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:25.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 -- 172.21.15.82:0/296462159 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284008b20 con 0x7fd284003210 2020-04-02T23:49:25.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a0a16700 1 --2- 172.21.15.82:0/296462159 >> v2:172.21.15.50:3300/0 conn(0x7fd284005c90 0x7fd284008150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:49:25.836 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd29c066b20 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd29c066b20 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fd29c066b20 tx=0x7fd29400ffc0).ready entity=mon.2 client_cookie=7bc46d5dcac07e5f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:25.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd29c066b20 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd28ffff700 1 -- 172.21.15.82:0/296462159 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd294011660 con 0x7fd284003210 2020-04-02T23:49:25.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd29c066b20 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.837 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1217700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd29c066b20 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd28ffff700 1 -- 172.21.15.82:0/296462159 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2940117c0 con 0x7fd284003210 2020-04-02T23:49:25.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd28ffff700 1 -- 172.21.15.82:0/296462159 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd294011c00 con 0x7fd284003210 2020-04-02T23:49:25.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a347b700 1 -- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 msgr2=0x7fd284005660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a347b700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd284003210 0x7fd284005660 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fd29c066b20 tx=0x7fd29400ffc0).stop 2020-04-02T23:49:25.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.824+0000 7fd2a1a18700 1 -- 172.21.15.82:0/296462159 reap_dead start 2020-04-02T23:49:25.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.825+0000 7fd2a347b700 1 -- 172.21.15.82:0/296462159 shutdown_connections 2020-04-02T23:49:25.838 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.825+0000 7fd2a347b700 1 --2- 172.21.15.82:0/296462159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29c136870 0x7fd29c0a4ff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.825+0000 7fd2a347b700 1 -- 172.21.15.82:0/296462159 >> 172.21.15.82:0/296462159 conn(0x7fd29c09de60 msgr2=0x7fd29c09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.825+0000 7fd2a347b700 1 -- 172.21.15.82:0/296462159 shutdown_connections 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.825+0000 7fd2a347b700 1 -- 172.21.15.82:0/296462159 wait complete. 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a347b700 1 Processor -- start 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a347b700 1 -- start start 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a347b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 0x7fd29c065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a347b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c065f70 con 0x7fd29c05b390 2020-04-02T23:49:25.839 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a347b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c05bf00 con 0x7fd29c136870 2020-04-02T23:49:25.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a347b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c065d70 con 0x7fd29c148b10 2020-04-02T23:49:25.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a1217700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd29c136870 0x7fd29c148400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55786/0 (socket says 172.21.15.82:55786) 2020-04-02T23:49:25.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a1217700 1 -- 172.21.15.82:0/2146375147 learned_addr learned my addr 172.21.15.82:0/2146375147 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:25.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327401135 0 0) 0x7fd29c05bf00 con 0x7fd29c136870 2020-04-02T23:49:25.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c002fe0 con 0x7fd29c136870 2020-04-02T23:49:25.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.826+0000 7fd2a1a18700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 0x7fd29c065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.840 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1191704991 0 0) 0x7fd27c002fe0 con 0x7fd29c136870 2020-04-02T23:49:25.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 --> v1:172.21.15.82:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd29c05bf00 con 0x7fd29c136870 2020-04-02T23:49:25.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7fd294001210 con 0x7fd29c136870 2020-04-02T23:49:25.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 msgr2=0x7fd29c065910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 0x7fd29c065910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:25.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 >> v1:172.21.15.82:6789/0 conn(0x7fd29c136870 legacy=0x7fd29c148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.841 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 >> v1:172.21.15.50:6789/0 conn(0x7fd29c05b390 legacy=0x7fd29c065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:25.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 0x7fd27c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:25.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd27c003d80 0x7fd27c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:25.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c065d70 con 0x7fd27c003d80 2020-04-02T23:49:25.842 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c005340 con 0x7fd27c0049b0 2020-04-02T23:49:25.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c005500 con 0x7fd29c148b10 2020-04-02T23:49:25.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a0a16700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 0x7fd27c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1a18700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd27c003d80 0x7fd27c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 -- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 msgr2=0x7fd27c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.843 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd29c148b10 0x7fd27c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 -- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd27c003d80 msgr2=0x7fd27c004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd27c003d80 0x7fd27c004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c063760 con 0x7fd27c0049b0 2020-04-02T23:49:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c063a00 con 0x7fd27c0049b0 2020-04-02T23:49:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c063050 con 0x7fd27c0049b0 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.827+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd294001530 con 0x7fd27c0049b0 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.828+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.828+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.828+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd294002a60 con 0x7fd27c0049b0 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.828+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd294002e80 con 0x7fd27c0049b0 2020-04-02T23:49:25.845 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.828+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.828+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd278003340 con 0x7fd27c0049b0 2020-04-02T23:49:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd294009250 con 0x7fd27c0049b0 2020-04-02T23:49:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd28e7fc700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd27c055920 0x7fd27c057de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fd294061c30 con 0x7fd27c0049b0 2020-04-02T23:49:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd2a0a16700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd27c055920 0x7fd27c057de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd2a0a16700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd27c055920 0x7fd27c057de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd29c067010 tx=0x7fd298000fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd2a0a16700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd27c055920 0x7fd27c057de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd29c067010 tx=0x7fd298000fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.829+0000 7fd2a0a16700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd27c055920 0x7fd27c057de0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fd29c067010 tx=0x7fd298000fa0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:25.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.832+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:25.847 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:25.832+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd29403d4e0 con 0x7fd27c0049b0 2020-04-02T23:49:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.013+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2780036e0 con 0x7fd27c0049b0 2020-04-02T23:49:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.013+0000 7fd2a1217700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.013+0000 7fd28e7fc700 1 -- 172.21.15.82:0/2146375147 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fd294040ac0 con 0x7fd27c0049b0 2020-04-02T23:49:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.014+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd27c055920 msgr2=0x7fd27c057de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.014+0000 7fd2a347b700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd27c055920 0x7fd27c057de0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fd29c067010 tx=0x7fd298000fa0).stop 2020-04-02T23:49:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.014+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 msgr2=0x7fd27c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.014+0000 7fd2a347b700 1 --2- 172.21.15.82:0/2146375147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd27c0049b0 0x7fd27c004dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7fd294002080 tx=0x7fd29400ffc0).stop 2020-04-02T23:49:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.014+0000 7fd2a1a18700 1 -- 172.21.15.82:0/2146375147 reap_dead start 2020-04-02T23:49:26.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.015+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 shutdown_connections 2020-04-02T23:49:26.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.015+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 >> 172.21.15.82:0/2146375147 conn(0x7fd29c09de60 msgr2=0x7fd29c068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:26.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.015+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 shutdown_connections 2020-04-02T23:49:26.018 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:26.015+0000 7fd2a347b700 1 -- 172.21.15.82:0/2146375147 wait complete. 2020-04-02T23:49:26.018 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:26.019 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:26.019 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:26.028 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:28.029 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:28.045 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.200+0000 7f4cc1fa2700 1 Processor -- start 2020-04-02T23:49:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.200+0000 7f4cc1fa2700 1 -- start start 2020-04-02T23:49:28.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cc1fa2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 0x7f4cbc066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:28.218 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cc1fa2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cbc0675c0 con 0x7f4cbc0aaf20 2020-04-02T23:49:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cc1fa2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cbc0abc50 con 0x7f4cbc09e7d0 2020-04-02T23:49:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cc1fa2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cbc13d100 con 0x7f4cbc09e3f0 2020-04-02T23:49:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cbb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 0x7f4cbc066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cbb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 0x7f4cbc066e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55754/0 (socket says 172.21.15.82:55754) 2020-04-02T23:49:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cbb7fe700 1 -- 172.21.15.82:0/2415399748 learned_addr learned my addr 172.21.15.82:0/2415399748 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cbb7fe700 1 -- 172.21.15.82:0/2415399748 >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 msgr2=0x7f4cbc066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:49:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cbb7fe700 1 -- 172.21.15.82:0/2415399748 >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 msgr2=0x7f4cbc066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:49:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/2415399748 >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 0x7f4cbc066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:49:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/2415399748 >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 0x7f4cbc066e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:49:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270832576 0 0) 0x7f4cb00010d0 con 0x7f4cbc09e7d0 2020-04-02T23:49:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.201+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca8003230 con 0x7f4cbc09e7d0 2020-04-02T23:49:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973861970 0 0) 0x7f4cbc0675c0 con 0x7f4cbc0aaf20 2020-04-02T23:49:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cb00010d0 con 0x7f4cbc0aaf20 2020-04-02T23:49:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3029962108 0 0) 0x7f4ca8003230 con 0x7f4cbc09e7d0 2020-04-02T23:49:28.221 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 msgr2=0x7f4cbc066e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:49:28.221 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 --2- 172.21.15.82:0/2415399748 >> v2:172.21.15.82:3300/0 conn(0x7f4cbc09e3f0 0x7f4cbc066e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:28.221 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 >> v1:172.21.15.50:6789/0 conn(0x7f4cbc0aaf20 legacy=0x7f4cbc143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:28.221 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc13c2b0 con 0x7f4cbc09e7d0 2020-04-02T23:49:28.221 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f4cb0001860 con 0x7f4cbc09e7d0 2020-04-02T23:49:28.221 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 >> v1:172.21.15.82:6789/0 conn(0x7f4cbc09e7d0 legacy=0x7f4cbc13c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:28.221 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80038b0 0x7f4ca8003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ca8004db0 0x7f4ca800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc13d100 con 0x7f4ca80038b0 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80053a0 con 0x7f4ca80044d0 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca800bc00 con 0x7f4ca8004db0 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80038b0 0x7f4ca8003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:28.222 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbbfff700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ca8004db0 0x7f4ca800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 -- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ca8004db0 msgr2=0x7f4ca800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ca8004db0 0x7f4ca800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:28.227 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 -- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80038b0 msgr2=0x7f4ca8003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80038b0 0x7f4ca8003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 -- 172.21.15.82:0/2415399748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8003230 con 0x7f4ca80044d0 2020-04-02T23:49:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80038b0 0x7f4ca8003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:49:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbbfff700 1 -- 172.21.15.82:0/2415399748 reap_dead start 2020-04-02T23:49:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4cb0001630 tx=0x7f4cb000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4cb0001630 tx=0x7f4cb000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f4cb0001630 tx=0x7f4cb000c3a0).ready entity=mon.1 client_cookie=c13318cafe786258 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f4cb0001630 tx=0x7f4cb000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f4cb0001630 tx=0x7f4cb000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb000ee90 con 0x7f4ca80044d0 2020-04-02T23:49:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f4cb0001630 tx=0x7f4cb000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb000b450 con 0x7f4ca80044d0 2020-04-02T23:49:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cba7fc700 1 -- 172.21.15.82:0/2415399748 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb0010390 con 0x7f4ca80044d0 2020-04-02T23:49:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 msgr2=0x7f4ca8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.202+0000 7f4cc1fa2700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f4cb0001630 tx=0x7f4cb000c3a0).stop 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.203+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/2415399748 shutdown_connections 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.203+0000 7f4cc1fa2700 1 --2- 172.21.15.82:0/2415399748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ca80044d0 0x7f4ca8004950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.203+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/2415399748 >> 172.21.15.82:0/2415399748 conn(0x7f4cbc0abdf0 msgr2=0x7f4cbc0ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.203+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/2415399748 shutdown_connections 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.203+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/2415399748 wait complete. 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.204+0000 7f4cc1fa2700 1 Processor -- start 2020-04-02T23:49:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.204+0000 7f4cc1fa2700 1 -- start start 2020-04-02T23:49:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cc1fa2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ca80044d0 0x7f4cbc136c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cc1fa2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cbc139da0 con 0x7f4cbc134bd0 2020-04-02T23:49:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cc1fa2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cbc1335d0 con 0x7f4cbc14a350 2020-04-02T23:49:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cc1fa2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cbc1370d0 con 0x7f4ca80044d0 2020-04-02T23:49:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbbfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4cbc14a350 0x7f4cbc150f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55818/0 (socket says 172.21.15.82:55818) 2020-04-02T23:49:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbbfff700 1 -- 172.21.15.82:0/1182245805 learned_addr learned my addr 172.21.15.82:0/1182245805 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> v2:172.21.15.50:3300/0 conn(0x7f4ca80044d0 0x7f4cbc136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255001572 0 0) 0x7f4cbc1335d0 con 0x7f4cbc14a350 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c9c002fe0 con 0x7f4cbc14a350 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1830795687 0 0) 0x7f4c9c002fe0 con 0x7f4cbc14a350 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 -- 172.21.15.82:0/1182245805 >> v1:172.21.15.82:6789/0 conn(0x7f4cbc14a350 legacy=0x7f4cbc150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 -- 172.21.15.82:0/1182245805 >> v1:172.21.15.50:6789/0 conn(0x7f4cbc134bd0 legacy=0x7f4cbc149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 -- 172.21.15.82:0/1182245805 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc133f50 con 0x7f4ca80044d0 2020-04-02T23:49:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> v2:172.21.15.50:3300/0 conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> v2:172.21.15.50:3300/0 conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.205+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb4002010 con 0x7f4ca80044d0 2020-04-02T23:49:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cbc0a8f10 con 0x7f4ca80044d0 2020-04-02T23:49:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac005ca0 con 0x7f4ca80044d0 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cac008a30 con 0x7f4ca80044d0 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cbc133aa0 con 0x7f4ca80044d0 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.206+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cbc056c50 con 0x7f4ca80044d0 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4cac008c70 con 0x7f4ca80044d0 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cb8ff9700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 0x7f4c9c04fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f4cac060730 con 0x7f4ca80044d0 2020-04-02T23:49:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 0x7f4c9c04fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 0x7f4c9c04fd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cb000b9c0 tx=0x7f4cb000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 0x7f4c9c04fd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cb000b9c0 tx=0x7f4cb000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.207+0000 7f4cbaffd700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 0x7f4c9c04fd10 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f4cb000b9c0 tx=0x7f4cb000c3a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.211+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.211+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4cac03be10 con 0x7f4ca80044d0 2020-04-02T23:49:28.395 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.393+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cbc0a9770 con 0x7f4ca80044d0 2020-04-02T23:49:28.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.395+0000 7f4cbb7fe700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:28.396 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.395+0000 7f4cb8ff9700 1 -- 172.21.15.82:0/1182245805 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f4cac03f430 con 0x7f4ca80044d0 2020-04-02T23:49:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:28.397 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.395+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 msgr2=0x7f4c9c04fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.395+0000 7f4cc1fa2700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 0x7f4c9c04fd10 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f4cb000b9c0 tx=0x7f4cb000c3a0).stop 2020-04-02T23:49:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.395+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 msgr2=0x7f4cbc136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.395+0000 7f4cc1fa2700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f4cb000e960 tx=0x7f4cac010aa0).stop 2020-04-02T23:49:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.395+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 shutdown_connections 2020-04-02T23:49:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.396+0000 7f4cc1fa2700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4c9c04d850 0x7f4c9c04fd10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.396+0000 7f4cc1fa2700 1 --2- 172.21.15.82:0/1182245805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca80044d0 0x7f4cbc136c70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.396+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 >> 172.21.15.82:0/1182245805 conn(0x7f4cbc0abdf0 msgr2=0x7f4cbc068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.396+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 shutdown_connections 2020-04-02T23:49:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:28.396+0000 7f4cc1fa2700 1 -- 172.21.15.82:0/1182245805 wait complete. 2020-04-02T23:49:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:28.408 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:30.411 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:30.427 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:30.582 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.580+0000 7fe65af1f700 1 Processor -- start 2020-04-02T23:49:30.583 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe65af1f700 1 -- start start 2020-04-02T23:49:30.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe65af1f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6540abb00 0x7fe6540a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:30.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe65af1f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe654138680 0x7fe6540a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:30.601 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe65af1f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6540a77a0 con 0x7fe6540666c0 2020-04-02T23:49:30.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe65af1f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6541395c0 con 0x7fe6540abb00 2020-04-02T23:49:30.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe65af1f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe654138ae0 con 0x7fe654138680 2020-04-02T23:49:30.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe658cbb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6540abb00 0x7fe6540a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:30.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe658cbb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6540abb00 0x7fe6540a3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55778/0 (socket says 172.21.15.82:55778) 2020-04-02T23:49:30.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe658cbb700 1 -- 172.21.15.82:0/3549512853 learned_addr learned my addr 172.21.15.82:0/3549512853 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:30.602 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.581+0000 7fe653fff700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe654138680 0x7fe6540a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:30.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 -- 172.21.15.82:0/3549512853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe654138680 msgr2=0x7fe6540a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:30.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe654138680 0x7fe6540a69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:30.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 -- 172.21.15.82:0/3549512853 >> v1:172.21.15.50:6789/0 conn(0x7fe6540666c0 legacy=0x7fe654066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:30.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 -- 172.21.15.82:0/3549512853 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540a62b0 con 0x7fe6540abb00 2020-04-02T23:49:30.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3549512853 >> v2:172.21.15.82:3300/0 conn(0x7fe6540abb00 0x7fe6540a3e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3549512853 >> v2:172.21.15.82:3300/0 conn(0x7fe6540abb00 0x7fe6540a3e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.603 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540abb00 0x7fe6540a3e20 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).ready entity=mon.1 client_cookie=42b598e8b5be77bb server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540abb00 0x7fe6540a3e20 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe6537fe700 1 -- 172.21.15.82:0/3549512853 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c00a160 con 0x7fe6540abb00 2020-04-02T23:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540abb00 0x7fe6540a3e20 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540abb00 0x7fe6540a3e20 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe6537fe700 1 -- 172.21.15.82:0/3549512853 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c00a2c0 con 0x7fe6540abb00 2020-04-02T23:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe6537fe700 1 -- 172.21.15.82:0/3549512853 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c00a6e0 con 0x7fe6540abb00 2020-04-02T23:49:30.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 -- 172.21.15.82:0/3549512853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540abb00 msgr2=0x7fe6540a3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:30.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540abb00 0x7fe6540a3e20 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).stop 2020-04-02T23:49:30.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 -- 172.21.15.82:0/3549512853 shutdown_connections 2020-04-02T23:49:30.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540abb00 0x7fe6540a3e20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:30.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3549512853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe654138680 0x7fe6540a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:30.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 -- 172.21.15.82:0/3549512853 >> 172.21.15.82:0/3549512853 conn(0x7fe65409de60 msgr2=0x7fe65409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:30.605 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 -- 172.21.15.82:0/3549512853 shutdown_connections 2020-04-02T23:49:30.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.582+0000 7fe65af1f700 1 -- 172.21.15.82:0/3549512853 wait complete. 2020-04-02T23:49:30.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.583+0000 7fe65af1f700 1 Processor -- start 2020-04-02T23:49:30.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.583+0000 7fe65af1f700 1 -- start start 2020-04-02T23:49:30.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe65af1f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6540666c0 0x7fe654146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:30.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe65af1f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6540abb00 0x7fe654061b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:30.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe65af1f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe654138680 0x7fe654061ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:30.606 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe65af1f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe654132ea0 con 0x7fe6540666c0 2020-04-02T23:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe65af1f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe654147150 con 0x7fe654138680 2020-04-02T23:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe65af1f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541473f0 con 0x7fe6540abb00 2020-04-02T23:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe654138680 0x7fe654061ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe654138680 0x7fe654061ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55786/0 (socket says 172.21.15.82:55786) 2020-04-02T23:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 -- 172.21.15.82:0/3994939237 learned_addr learned my addr 172.21.15.82:0/3994939237 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe653fff700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6540abb00 0x7fe654061b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3994939237 >> v2:172.21.15.50:3300/0 conn(0x7fe6540666c0 0x7fe654146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 -- 172.21.15.82:0/3994939237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6540abb00 msgr2=0x7fe654061b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6540abb00 0x7fe654061b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 -- 172.21.15.82:0/3994939237 >> v2:172.21.15.50:3300/0 conn(0x7fe6540666c0 msgr2=0x7fe654146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> v2:172.21.15.50:3300/0 conn(0x7fe6540666c0 0x7fe654146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 -- 172.21.15.82:0/3994939237 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540616f0 con 0x7fe654138680 2020-04-02T23:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.584+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> v2:172.21.15.82:3300/0 conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> v2:172.21.15.82:3300/0 conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:30.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe651ffb700 1 -- 172.21.15.82:0/3994939237 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe644006bc0 con 0x7fe654138680 2020-04-02T23:49:30.609 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe651ffb700 1 -- 172.21.15.82:0/3994939237 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644006d20 con 0x7fe654138680 2020-04-02T23:49:30.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe654146e60 con 0x7fe654138680 2020-04-02T23:49:30.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe651ffb700 1 -- 172.21.15.82:0/3994939237 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe644008350 con 0x7fe654138680 2020-04-02T23:49:30.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe654137760 con 0x7fe654138680 2020-04-02T23:49:30.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.585+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe654056c50 con 0x7fe654138680 2020-04-02T23:49:30.610 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe651ffb700 1 -- 172.21.15.82:0/3994939237 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe6440085c0 con 0x7fe654138680 2020-04-02T23:49:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe651ffb700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 0x7fe63404faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe651ffb700 1 -- 172.21.15.82:0/3994939237 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fe644061090 con 0x7fe654138680 2020-04-02T23:49:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 0x7fe63404faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 0x7fe63404faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 0x7fe63404faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.612 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.586+0000 7fe658cbb700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 0x7fe63404faf0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:30.612 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.589+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.612 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.589+0000 7fe651ffb700 1 -- 172.21.15.82:0/3994939237 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe64403c790 con 0x7fe654138680 2020-04-02T23:49:30.776 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.775+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe65405d150 con 0x7fe654138680 2020-04-02T23:49:30.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.775+0000 7fe6594bc700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:30.777 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.775+0000 7fe651ffb700 1 -- 172.21.15.82:0/3994939237 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fe64403fdb0 con 0x7fe654138680 2020-04-02T23:49:30.778 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:30.778 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:30.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.776+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 msgr2=0x7fe63404faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:30.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.776+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 0x7fe63404faf0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fe6540a5bd0 tx=0x7fe64c007dc0).stop 2020-04-02T23:49:30.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.776+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 msgr2=0x7fe654061ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:30.779 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.776+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7fe644001f50 tx=0x7fe644010890).stop 2020-04-02T23:49:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.776+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 shutdown_connections 2020-04-02T23:49:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.776+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fe63404d630 0x7fe63404faf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.776+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe654138680 0x7fe654061ff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.777+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3994939237 >> v2:172.21.15.50:3300/0 conn(0x7fe6540666c0 0x7fe654146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.777+0000 7fe65af1f700 1 --2- 172.21.15.82:0/3994939237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe6540abb00 0x7fe654061b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.777+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 >> 172.21.15.82:0/3994939237 conn(0x7fe65409de60 msgr2=0x7fe6540a3910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.777+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 shutdown_connections 2020-04-02T23:49:30.781 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:30.777+0000 7fe65af1f700 1 -- 172.21.15.82:0/3994939237 wait complete. 2020-04-02T23:49:30.781 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:30.789 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:32.790 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:32.807 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:32.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.959+0000 7f36b2028700 1 Processor -- start 2020-04-02T23:49:32.961 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.959+0000 7f36b2028700 1 -- start start 2020-04-02T23:49:32.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36b2028700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:32.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36b2028700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36ac1367e0 0x7f36ac140220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:32.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36b2028700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0a3d50 con 0x7f36ac0a4ea0 2020-04-02T23:49:32.968 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36b2028700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac0a4110 con 0x7f36ac0a29a0 2020-04-02T23:49:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36b2028700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac066bf0 con 0x7f36ac1367e0 2020-04-02T23:49:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36ac1367e0 0x7f36ac140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36ac1367e0 0x7f36ac140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55794/0 (socket says 172.21.15.82:55794) 2020-04-02T23:49:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36aaffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f36ac0a4ea0 0x7f36ac1360d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55842/0 (socket says 172.21.15.82:55842) 2020-04-02T23:49:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 -- 172.21.15.82:0/1423148098 learned_addr learned my addr 172.21.15.82:0/1423148098 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1423148098 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 -- 172.21.15.82:0/1423148098 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a29a0 msgr2=0x7f36ac0a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 --2- 172.21.15.82:0/1423148098 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 -- 172.21.15.82:0/1423148098 >> v1:172.21.15.82:6789/0 conn(0x7f36ac0a4ea0 legacy=0x7f36ac1360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 -- 172.21.15.82:0/1423148098 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0a4300 con 0x7f36ac1367e0 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36aa7fc700 1 -- 172.21.15.82:0/1423148098 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269534430 0 0) 0x7f36ac0a3d50 con 0x7f36ac0a4ea0 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 --2- 172.21.15.82:0/1423148098 >> v2:172.21.15.82:3300/0 conn(0x7f36ac1367e0 0x7f36ac140220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36a4002f30 tx=0x7f36a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 --2- 172.21.15.82:0/1423148098 >> v2:172.21.15.82:3300/0 conn(0x7f36ac1367e0 0x7f36ac140220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36a4002f30 tx=0x7f36a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 --2- 172.21.15.82:0/1423148098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac1367e0 0x7f36ac140220 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f36a4002f30 tx=0x7f36a4007a40).ready entity=mon.1 client_cookie=abd8856678dcc097 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36abfff700 1 --2- 172.21.15.82:0/1423148098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac1367e0 0x7f36ac140220 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f36a4002f30 tx=0x7f36a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.960+0000 7f36aa7fc700 1 -- 172.21.15.82:0/1423148098 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a4011720 con 0x7f36ac1367e0 2020-04-02T23:49:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36abfff700 1 --2- 172.21.15.82:0/1423148098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac1367e0 0x7f36ac140220 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f36a4002f30 tx=0x7f36a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36aa7fc700 1 -- 172.21.15.82:0/1423148098 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a4011880 con 0x7f36ac1367e0 2020-04-02T23:49:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36abfff700 1 --2- 172.21.15.82:0/1423148098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac1367e0 0x7f36ac140220 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f36a4002f30 tx=0x7f36a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36aa7fc700 1 -- 172.21.15.82:0/1423148098 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a4011c20 con 0x7f36ac1367e0 2020-04-02T23:49:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 -- 172.21.15.82:0/1423148098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac1367e0 msgr2=0x7f36ac140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 --2- 172.21.15.82:0/1423148098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac1367e0 0x7f36ac140220 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f36a4002f30 tx=0x7f36a4007a40).stop 2020-04-02T23:49:32.972 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 -- 172.21.15.82:0/1423148098 shutdown_connections 2020-04-02T23:49:32.972 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 --2- 172.21.15.82:0/1423148098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac1367e0 0x7f36ac140220 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:32.972 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 --2- 172.21.15.82:0/1423148098 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:32.972 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 -- 172.21.15.82:0/1423148098 >> 172.21.15.82:0/1423148098 conn(0x7f36ac09de60 msgr2=0x7f36ac09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:32.972 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 -- 172.21.15.82:0/1423148098 shutdown_connections 2020-04-02T23:49:32.972 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.961+0000 7f36b2028700 1 -- 172.21.15.82:0/1423148098 wait complete. 2020-04-02T23:49:32.972 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.962+0000 7f36b2028700 1 Processor -- start 2020-04-02T23:49:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.962+0000 7f36b2028700 1 -- start start 2020-04-02T23:49:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36b2028700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0656e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36b2028700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a4ea0 0x7f36ac12d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55796/0 (socket says 172.21.15.82:55796) 2020-04-02T23:49:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 -- 172.21.15.82:0/1260372747 learned_addr learned my addr 172.21.15.82:0/1260372747 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0648c0 con 0x7f36ac1367e0 2020-04-02T23:49:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac12ea80 con 0x7f36ac0a4ea0 2020-04-02T23:49:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac12ed20 con 0x7f36ac0a29a0 2020-04-02T23:49:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36aaffd700 1 --2- 172.21.15.82:0/1260372747 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a4ea0 0x7f36ac12d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 -- 172.21.15.82:0/1260372747 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a4ea0 msgr2=0x7f36ac12d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a4ea0 0x7f36ac12d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 -- 172.21.15.82:0/1260372747 >> v1:172.21.15.82:6789/0 conn(0x7f36ac1367e0 legacy=0x7f36ac0625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 -- 172.21.15.82:0/1260372747 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac065240 con 0x7f36ac0a29a0 2020-04-02T23:49:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> v2:172.21.15.82:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.976 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> v2:172.21.15.82:3300/0 conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.976 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.963+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:32.976 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.976 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36a8ff9700 1 -- 172.21.15.82:0/1260372747 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c005e20 con 0x7f36ac0a29a0 2020-04-02T23:49:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36a8ff9700 1 -- 172.21.15.82:0/1260372747 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c012950 con 0x7f36ac0a29a0 2020-04-02T23:49:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36a8ff9700 1 -- 172.21.15.82:0/1260372747 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c012cf0 con 0x7f36ac0a29a0 2020-04-02T23:49:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac063680 con 0x7f36ac0a29a0 2020-04-02T23:49:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac147b60 con 0x7f36ac0a29a0 2020-04-02T23:49:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.964+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac065440 con 0x7f36ac0a29a0 2020-04-02T23:49:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36a8ff9700 1 -- 172.21.15.82:0/1260372747 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f369c007180 con 0x7f36ac0a29a0 2020-04-02T23:49:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36a8ff9700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 0x7f368c04f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36a8ff9700 1 -- 172.21.15.82:0/1260372747 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f369c061130 con 0x7f36ac0a29a0 2020-04-02T23:49:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36aaffd700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 0x7f368c04f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:32.996 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36aaffd700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 0x7f368c04f990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36a0000b80 tx=0x7f36a000c900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.996 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36aaffd700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 0x7f368c04f990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36a0000b80 tx=0x7f36a000c900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.996 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.965+0000 7f36aaffd700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 0x7f368c04f990 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f36a0000b80 tx=0x7f36a000c900).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:32.996 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.968+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:32.997 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:32.968+0000 7f36a8ff9700 1 -- 172.21.15.82:0/1260372747 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f36ac065440 con 0x7f36ac0a29a0 2020-04-02T23:49:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.151+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36ac065440 con 0x7f36ac0a29a0 2020-04-02T23:49:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.151+0000 7f36ab7fe700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.151+0000 7f36a8ff9700 1 -- 172.21.15.82:0/1260372747 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f36ac065440 con 0x7f36ac0a29a0 2020-04-02T23:49:33.154 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:33.154 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:48:24.534327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.82:6835/1148797459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1148797459},{"type":"v1","addr":"172.21.15.82:6835","nonce":1148797459}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:33.156 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 msgr2=0x7f368c04f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:33.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 0x7f368c04f990 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f36a0000b80 tx=0x7f36a000c900).stop 2020-04-02T23:49:33.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 msgr2=0x7f36ac0656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:33.157 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f369c0032b0 tx=0x7f369c010fb0).stop 2020-04-02T23:49:33.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 shutdown_connections 2020-04-02T23:49:33.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f368c04d4d0 0x7f368c04f990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:33.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 --2- 172.21.15.82:0/1260372747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac0a29a0 0x7f36ac0656e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:33.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 --2- 172.21.15.82:0/1260372747 >> v2:172.21.15.50:3300/0 conn(0x7f36ac0a4ea0 0x7f36ac12d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:33.158 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 >> 172.21.15.82:0/1260372747 conn(0x7f36ac09de60 msgr2=0x7f36ac135ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:33.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 shutdown_connections 2020-04-02T23:49:33.159 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:33.153+0000 7f36b2028700 1 -- 172.21.15.82:0/1260372747 wait complete. 2020-04-02T23:49:33.159 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2020-04-02T23:49:33.165 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-04-02T23:49:35.171 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:35.187 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:35.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.340+0000 7fb51759e700 1 Processor -- start 2020-04-02T23:49:35.342 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.340+0000 7fb51759e700 1 -- start start 2020-04-02T23:49:35.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.340+0000 7fb51759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb5180a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:35.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.340+0000 7fb51759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5180a7090 0x7fb518135610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:35.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51805f1e0 con 0x7fb518135a70 2020-04-02T23:49:35.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180a67b0 con 0x7fb5180a7090 2020-04-02T23:49:35.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180a6a50 con 0x7fb5180a2300 2020-04-02T23:49:35.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb5180a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.348 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb5180a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55804/0 (socket says 172.21.15.82:55804) 2020-04-02T23:49:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 -- 172.21.15.82:0/3739809899 learned_addr learned my addr 172.21.15.82:0/3739809899 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb515d9b700 1 --2- 172.21.15.82:0/3739809899 >> v2:172.21.15.50:3300/0 conn(0x7fb5180a7090 0x7fb518135610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 -- 172.21.15.82:0/3739809899 >> v2:172.21.15.50:3300/0 conn(0x7fb5180a7090 msgr2=0x7fb518135610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- 172.21.15.82:0/3739809899 >> v2:172.21.15.50:3300/0 conn(0x7fb5180a7090 0x7fb518135610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 -- 172.21.15.82:0/3739809899 >> v1:172.21.15.50:6789/0 conn(0x7fb518135a70 legacy=0x7fb518135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 -- 172.21.15.82:0/3739809899 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180a6cf0 con 0x7fb5180a2300 2020-04-02T23:49:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- 172.21.15.82:0/3739809899 >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb5180a45f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- 172.21.15.82:0/3739809899 >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb5180a45f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- 172.21.15.82:0/3739809899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb5180a45f0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).ready entity=mon.1 client_cookie=de5c09d65fa71014 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- 172.21.15.82:0/3739809899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb5180a45f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- 172.21.15.82:0/3739809899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb5180a45f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51559a700 1 -- 172.21.15.82:0/3739809899 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51000a160 con 0x7fb5180a2300 2020-04-02T23:49:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51659c700 1 --2- 172.21.15.82:0/3739809899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb5180a45f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51559a700 1 -- 172.21.15.82:0/3739809899 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51000a2c0 con 0x7fb5180a2300 2020-04-02T23:49:35.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51559a700 1 -- 172.21.15.82:0/3739809899 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51000a6a0 con 0x7fb5180a2300 2020-04-02T23:49:35.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51759e700 1 -- 172.21.15.82:0/3739809899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 msgr2=0x7fb5180a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.341+0000 7fb51759e700 1 --2- 172.21.15.82:0/3739809899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb5180a45f0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).stop 2020-04-02T23:49:35.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.342+0000 7fb51759e700 1 -- 172.21.15.82:0/3739809899 shutdown_connections 2020-04-02T23:49:35.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.342+0000 7fb51759e700 1 --2- 172.21.15.82:0/3739809899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb5180a45f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.351 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.342+0000 7fb51759e700 1 --2- 172.21.15.82:0/3739809899 >> v2:172.21.15.50:3300/0 conn(0x7fb5180a7090 0x7fb518135610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:35.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.342+0000 7fb51759e700 1 -- 172.21.15.82:0/3739809899 >> 172.21.15.82:0/3739809899 conn(0x7fb51809de60 msgr2=0x7fb51809e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:35.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.342+0000 7fb51759e700 1 -- 172.21.15.82:0/3739809899 shutdown_connections 2020-04-02T23:49:35.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.342+0000 7fb51759e700 1 -- 172.21.15.82:0/3739809899 wait complete. 2020-04-02T23:49:35.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51759e700 1 Processor -- start 2020-04-02T23:49:35.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51759e700 1 -- start start 2020-04-02T23:49:35.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb518131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:35.352 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5180a7090 0x7fb51812cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb518130380 con 0x7fb518135a70 2020-04-02T23:49:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5181301a0 con 0x7fb5180a2300 2020-04-02T23:49:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb518130620 con 0x7fb5180a7090 2020-04-02T23:49:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb518131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb518131d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55810/0 (socket says 172.21.15.82:55810) 2020-04-02T23:49:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb51659c700 1 -- 172.21.15.82:0/1023220091 learned_addr learned my addr 172.21.15.82:0/1023220091 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.343+0000 7fb515d9b700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5180a7090 0x7fb51812cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 -- 172.21.15.82:0/1023220091 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5180a7090 msgr2=0x7fb51812cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5180a7090 0x7fb51812cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 -- 172.21.15.82:0/1023220091 >> v1:172.21.15.50:6789/0 conn(0x7fb518135a70 legacy=0x7fb51812a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 -- 172.21.15.82:0/1023220091 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180a0d80 con 0x7fb5180a2300 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> v2:172.21.15.82:3300/0 conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1023220091 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51000a720 con 0x7fb5180a2300 2020-04-02T23:49:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1023220091 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510005c30 con 0x7fb5180a2300 2020-04-02T23:49:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5181321a0 con 0x7fb5180a2300 2020-04-02T23:49:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1023220091 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb510007150 con 0x7fb5180a2300 2020-04-02T23:49:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.344+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51812d3b0 con 0x7fb5180a2300 2020-04-02T23:49:35.356 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.356 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1023220091 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb5100073c0 con 0x7fb5180a2300 2020-04-02T23:49:35.356 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.356 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb518130790 con 0x7fb5180a2300 2020-04-02T23:49:35.356 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb50f7fe700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 0x7fb4fc04fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:35.356 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1023220091 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fb510061c90 con 0x7fb5180a2300 2020-04-02T23:49:35.356 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb515d9b700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 0x7fb4fc04fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.345+0000 7fb515d9b700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 0x7fb4fc04fa00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb500002f30 tx=0x7fb500002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.346+0000 7fb515d9b700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 0x7fb4fc04fa00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb500002f30 tx=0x7fb500002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.346+0000 7fb515d9b700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 0x7fb4fc04fa00 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fb500002f30 tx=0x7fb500002ed0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.349+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.358 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.349+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1023220091 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb518130790 con 0x7fb5180a2300 2020-04-02T23:49:35.536 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.534+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb518130790 con 0x7fb5180a2300 2020-04-02T23:49:35.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.534+0000 7fb51659c700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.537 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.534+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1023220091 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+1787 (secure 0 0 0) 0x7fb518130790 con 0x7fb5180a2300 2020-04-02T23:49:35.537 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:35.537 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:34.268867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:replay","state_seq":1,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:35.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 msgr2=0x7fb4fc04fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 0x7fb4fc04fa00 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fb500002f30 tx=0x7fb500002ed0).stop 2020-04-02T23:49:35.538 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 msgr2=0x7fb518131d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fb5100032b0 tx=0x7fb510007dc0).stop 2020-04-02T23:49:35.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 shutdown_connections 2020-04-02T23:49:35.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fb4fc04d540 0x7fb4fc04fa00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5180a2300 0x7fb518131d40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 --2- 172.21.15.82:0/1023220091 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5180a7090 0x7fb51812cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.539 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 >> 172.21.15.82:0/1023220091 conn(0x7fb51809de60 msgr2=0x7fb5180a2930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:35.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 shutdown_connections 2020-04-02T23:49:35.540 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.536+0000 7fb51759e700 1 -- 172.21.15.82:0/1023220091 wait complete. 2020-04-02T23:49:35.540 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2020-04-02T23:49:35.548 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2020-04-02T23:49:35.549 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2020-04-02T23:49:35.549 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:35.562 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.706+0000 7fec8688b700 1 Processor -- start 2020-04-02T23:49:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.706+0000 7fec8688b700 1 -- start start 2020-04-02T23:49:35.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec8688b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:35.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec8688b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800a5820 con 0x7fec80140000 2020-04-02T23:49:35.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec8688b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800ab7b0 con 0x7fec800a6e30 2020-04-02T23:49:35.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec8688b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec80140490 con 0x7fec800a34b0 2020-04-02T23:49:35.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fec800a6e30 0x7fec8013f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55876/0 (socket says 172.21.15.82:55876) 2020-04-02T23:49:35.711 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7f7fe700 1 -- 172.21.15.82:0/1262526895 learned_addr learned my addr 172.21.15.82:0/1262526895 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:35.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7effd700 1 -- 172.21.15.82:0/1262526895 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397470538 0 0) 0x7fec800ab7b0 con 0x7fec800a6e30 2020-04-02T23:49:35.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7effd700 1 -- 172.21.15.82:0/1262526895 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec6c003230 con 0x7fec800a6e30 2020-04-02T23:49:35.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7effd700 1 -- 172.21.15.82:0/1262526895 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755115371 0 0) 0x7fec800a5820 con 0x7fec80140000 2020-04-02T23:49:35.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7effd700 1 -- 172.21.15.82:0/1262526895 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec800ab7b0 con 0x7fec80140000 2020-04-02T23:49:35.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7ffff700 1 -- 172.21.15.82:0/1262526895 >> v1:172.21.15.82:6789/0 conn(0x7fec800a6e30 legacy=0x7fec8013f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.712 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7ffff700 1 -- 172.21.15.82:0/1262526895 >> v1:172.21.15.50:6789/0 conn(0x7fec80140000 legacy=0x7fec80147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7ffff700 1 -- 172.21.15.82:0/1262526895 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800ab270 con 0x7fec800a34b0 2020-04-02T23:49:35.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec800a68b0 tx=0x7fec700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec800a68b0 tx=0x7fec700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.707+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec700088e0).ready entity=mon.2 client_cookie=b691a61c4e1d6233 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:35.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec7effd700 1 -- 172.21.15.82:0/1262526895 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec70008e40 con 0x7fec800a34b0 2020-04-02T23:49:35.713 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec7effd700 1 -- 172.21.15.82:0/1262526895 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec70011500 con 0x7fec800a34b0 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec8688b700 1 -- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 msgr2=0x7fec800a69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec8688b700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec700088e0).stop 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec7effd700 1 -- 172.21.15.82:0/1262526895 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec700118e0 con 0x7fec800a34b0 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec8688b700 1 -- 172.21.15.82:0/1262526895 shutdown_connections 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec8688b700 1 --2- 172.21.15.82:0/1262526895 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec800a34b0 0x7fec800a69d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.714 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec8688b700 1 -- 172.21.15.82:0/1262526895 >> 172.21.15.82:0/1262526895 conn(0x7fec8009de60 msgr2=0x7fec8009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:35.715 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec8688b700 1 -- 172.21.15.82:0/1262526895 shutdown_connections 2020-04-02T23:49:35.715 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.708+0000 7fec8688b700 1 -- 172.21.15.82:0/1262526895 wait complete. 2020-04-02T23:49:35.715 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.709+0000 7fec8688b700 1 Processor -- start 2020-04-02T23:49:35.715 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.709+0000 7fec8688b700 1 -- start start 2020-04-02T23:49:35.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec8688b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec800a34b0 0x7fec8014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:35.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec8688b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fec800a6e30 0x7fec8013d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:35.718 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec8688b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800a1dd0 con 0x7fec80140000 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec8688b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8013de10 con 0x7fec800a34b0 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec8688b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec800a6b70 con 0x7fec800a6e30 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fec800a6e30 0x7fec8013d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fec800a6e30 0x7fec8013d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55834/0 (socket says 172.21.15.82:55834) 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 -- 172.21.15.82:0/1643166958 learned_addr learned my addr 172.21.15.82:0/1643166958 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1643166958 >> v2:172.21.15.50:3300/0 conn(0x7fec800a34b0 0x7fec8014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 -- 172.21.15.82:0/1643166958 >> v2:172.21.15.50:3300/0 conn(0x7fec800a34b0 msgr2=0x7fec8014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> v2:172.21.15.50:3300/0 conn(0x7fec800a34b0 0x7fec8014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 -- 172.21.15.82:0/1643166958 >> v1:172.21.15.82:6789/0 conn(0x7fec80140000 legacy=0x7fec8013e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 -- 172.21.15.82:0/1643166958 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80061650 con 0x7fec800a6e30 2020-04-02T23:49:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> v2:172.21.15.82:3300/0 conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> v2:172.21.15.82:3300/0 conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7d7fa700 1 -- 172.21.15.82:0/1643166958 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7400c950 con 0x7fec800a6e30 2020-04-02T23:49:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7d7fa700 1 -- 172.21.15.82:0/1643166958 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7400cab0 con 0x7fec800a6e30 2020-04-02T23:49:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec800a1890 con 0x7fec800a6e30 2020-04-02T23:49:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.710+0000 7fec7d7fa700 1 -- 172.21.15.82:0/1643166958 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7400ce50 con 0x7fec800a6e30 2020-04-02T23:49:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.711+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec80066620 con 0x7fec800a6e30 2020-04-02T23:49:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.711+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.711+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8013ea60 con 0x7fec800a6e30 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.711+0000 7fec7d7fa700 1 -- 172.21.15.82:0/1643166958 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fec740055c0 con 0x7fec800a6e30 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.712+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.712+0000 7fec7d7fa700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 0x7fec6004f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.712+0000 7fec7d7fa700 1 -- 172.21.15.82:0/1643166958 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fec74060af0 con 0x7fec800a6e30 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.712+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 0x7fec6004f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.712+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 0x7fec6004f910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec800a3890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.712+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 0x7fec6004f910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec800a3890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.712+0000 7fec7ffff700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 0x7fec6004f910 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec800a3890).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.715+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.715+0000 7fec7d7fa700 1 -- 172.21.15.82:0/1643166958 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fec7403c190 con 0x7fec800a6e30 2020-04-02T23:49:35.899 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.897+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec8014e5d0 con 0x7fec800a6e30 2020-04-02T23:49:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.897+0000 7fec7f7fe700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.897+0000 7fec7d7fa700 1 -- 172.21.15.82:0/1643166958 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+1791 (secure 0 0 0) 0x7fec8014e5d0 con 0x7fec800a6e30 2020-04-02T23:49:35.900 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:35.900 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:35.569827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":39,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 msgr2=0x7fec6004f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 0x7fec6004f910 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7fec800a68b0 tx=0x7fec800a3890).stop 2020-04-02T23:49:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 msgr2=0x7fec8013d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7fec740010d0 tx=0x7fec740013d0).stop 2020-04-02T23:49:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 shutdown_connections 2020-04-02T23:49:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fec6004d450 0x7fec6004f910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 --2- 172.21.15.82:0/1643166958 >> v2:172.21.15.50:3300/0 conn(0x7fec800a34b0 0x7fec8014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 --2- 172.21.15.82:0/1643166958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec800a6e30 0x7fec8013d9b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 >> 172.21.15.82:0/1643166958 conn(0x7fec8009de60 msgr2=0x7fec800a5610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 shutdown_connections 2020-04-02T23:49:35.903 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:35.899+0000 7fec8688b700 1 -- 172.21.15.82:0/1643166958 wait complete. 2020-04-02T23:49:35.903 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 20 2020-04-02T23:49:35.911 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 20, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-04-02T23:47:03.694261+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 20, "ever_allowed_features": 2, "explicitly_allowed_features": 2, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4223": { "addr": "172.21.15.50:6833/2390920466", "addrs": { "addrvec": [ { "addr": "172.21.15.50:6832", "nonce": 2390920466, "type": "v2" }, { "addr": "172.21.15.50:6833", "nonce": 2390920466, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4223, "incarnation": 19, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:reconnect", "state_seq": 39 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "min_compat_client": "0 (unknown)", "modified": "2020-04-02T23:49:35.569827+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4223 } } } ], "standbys": [] } 2020-04-02T23:49:37.912 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:37.929 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:38.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.082+0000 7fd3a80b3700 1 Processor -- start 2020-04-02T23:49:38.085 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.082+0000 7fd3a80b3700 1 -- start start 2020-04-02T23:49:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a80b3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3a00a2ab0 0x7fd3a00aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a80b3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd3a0136870 0x7fd3a00a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a80b3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00a5820 con 0x7fd3a00a4b70 2020-04-02T23:49:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a80b3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00a4130 con 0x7fd3a00a2ab0 2020-04-02T23:49:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a80b3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00a43d0 con 0x7fd3a0136870 2020-04-02T23:49:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a6650700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd3a0136870 0x7fd3a00a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a6650700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd3a0136870 0x7fd3a00a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55848/0 (socket says 172.21.15.82:55848) 2020-04-02T23:49:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a6650700 1 -- 172.21.15.82:0/1541115277 learned_addr learned my addr 172.21.15.82:0/1541115277 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a5e4f700 1 --2- 172.21.15.82:0/1541115277 >> v2:172.21.15.50:3300/0 conn(0x7fd3a00a2ab0 0x7fd3a00aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a6650700 1 -- 172.21.15.82:0/1541115277 >> v2:172.21.15.50:3300/0 conn(0x7fd3a00a2ab0 msgr2=0x7fd3a00aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a6650700 1 --2- 172.21.15.82:0/1541115277 >> v2:172.21.15.50:3300/0 conn(0x7fd3a00a2ab0 0x7fd3a00aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a6650700 1 -- 172.21.15.82:0/1541115277 >> v1:172.21.15.50:6789/0 conn(0x7fd3a00a4b70 legacy=0x7fd3a0136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.083+0000 7fd3a6650700 1 -- 172.21.15.82:0/1541115277 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00a4670 con 0x7fd3a0136870 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a6650700 1 --2- 172.21.15.82:0/1541115277 >> v2:172.21.15.82:3300/0 conn(0x7fd3a0136870 0x7fd3a00a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3a005f560 tx=0x7fd398007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a6650700 1 --2- 172.21.15.82:0/1541115277 >> v2:172.21.15.82:3300/0 conn(0x7fd3a0136870 0x7fd3a00a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3a005f560 tx=0x7fd398007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a6650700 1 --2- 172.21.15.82:0/1541115277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a0136870 0x7fd3a00a4ff0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7fd3a005f560 tx=0x7fd398007dc0).ready entity=mon.1 client_cookie=9afa10ab42d2fe96 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a6650700 1 --2- 172.21.15.82:0/1541115277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a0136870 0x7fd3a00a4ff0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7fd3a005f560 tx=0x7fd398007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a4e4d700 1 -- 172.21.15.82:0/1541115277 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39800a160 con 0x7fd3a0136870 2020-04-02T23:49:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a6650700 1 --2- 172.21.15.82:0/1541115277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a0136870 0x7fd3a00a4ff0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7fd3a005f560 tx=0x7fd398007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a6650700 1 --2- 172.21.15.82:0/1541115277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a0136870 0x7fd3a00a4ff0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7fd3a005f560 tx=0x7fd398007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a4e4d700 1 -- 172.21.15.82:0/1541115277 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39800a2c0 con 0x7fd3a0136870 2020-04-02T23:49:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a4e4d700 1 -- 172.21.15.82:0/1541115277 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39800a6a0 con 0x7fd3a0136870 2020-04-02T23:49:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 -- 172.21.15.82:0/1541115277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a0136870 msgr2=0x7fd3a00a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/1541115277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a0136870 0x7fd3a00a4ff0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7fd3a005f560 tx=0x7fd398007dc0).stop 2020-04-02T23:49:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 -- 172.21.15.82:0/1541115277 shutdown_connections 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/1541115277 >> v2:172.21.15.50:3300/0 conn(0x7fd3a00a2ab0 0x7fd3a00aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/1541115277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a0136870 0x7fd3a00a4ff0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 -- 172.21.15.82:0/1541115277 >> 172.21.15.82:0/1541115277 conn(0x7fd3a009de60 msgr2=0x7fd3a009e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 -- 172.21.15.82:0/1541115277 shutdown_connections 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.084+0000 7fd3a80b3700 1 -- 172.21.15.82:0/1541115277 wait complete. 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.085+0000 7fd3a80b3700 1 Processor -- start 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.085+0000 7fd3a80b3700 1 -- start start 2020-04-02T23:49:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a80b3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd3a00a4b70 0x7fd3a00a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a80b3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd3a0136870 0x7fd3a0147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a80b3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a01482a0 con 0x7fd3a00a2ab0 2020-04-02T23:49:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a80b3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a0148540 con 0x7fd3a00a4b70 2020-04-02T23:49:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a80b3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a0147fc0 con 0x7fd3a0136870 2020-04-02T23:49:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd3a00a4b70 0x7fd3a00a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd3a00a4b70 0x7fd3a00a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55854/0 (socket says 172.21.15.82:55854) 2020-04-02T23:49:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 -- 172.21.15.82:0/2326139369 learned_addr learned my addr 172.21.15.82:0/2326139369 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a6650700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd3a0136870 0x7fd3a0147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 -- 172.21.15.82:0/2326139369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd3a0136870 msgr2=0x7fd3a0147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd3a0136870 0x7fd3a0147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 -- 172.21.15.82:0/2326139369 >> v1:172.21.15.50:6789/0 conn(0x7fd3a00a2ab0 legacy=0x7fd3a0144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 -- 172.21.15.82:0/2326139369 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0139310 con 0x7fd3a00a4b70 2020-04-02T23:49:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> v2:172.21.15.82:3300/0 conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> v2:172.21.15.82:3300/0 conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.086+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd392ffd700 1 -- 172.21.15.82:0/2326139369 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39c0059f0 con 0x7fd3a00a4b70 2020-04-02T23:49:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd392ffd700 1 -- 172.21.15.82:0/2326139369 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c005b90 con 0x7fd3a00a4b70 2020-04-02T23:49:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a01395c0 con 0x7fd3a00a4b70 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd392ffd700 1 -- 172.21.15.82:0/2326139369 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39c011290 con 0x7fd3a00a4b70 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a0144f40 con 0x7fd3a00a4b70 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.087+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd392ffd700 1 -- 172.21.15.82:0/2326139369 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd39c0113f0 con 0x7fd3a00a4b70 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a01489a0 con 0x7fd3a00a4b70 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd392ffd700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 0x7fd38004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd392ffd700 1 -- 172.21.15.82:0/2326139369 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fd39c060c10 con 0x7fd3a00a4b70 2020-04-02T23:49:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd3a5e4f700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 0x7fd38004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd3a5e4f700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 0x7fd38004fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd394002f30 tx=0x7fd394007c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd3a5e4f700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 0x7fd38004fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd394002f30 tx=0x7fd394007c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.088+0000 7fd3a5e4f700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 0x7fd38004fa90 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fd394002f30 tx=0x7fd394007c20).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.091+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.091+0000 7fd392ffd700 1 -- 172.21.15.82:0/2326139369 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd39c03c310 con 0x7fd3a00a4b70 2020-04-02T23:49:38.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.274+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3a0056c50 con 0x7fd3a00a4b70 2020-04-02T23:49:38.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.275+0000 7fd3a564e700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:38.278 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.275+0000 7fd392ffd700 1 -- 172.21.15.82:0/2326139369 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1794 (secure 0 0 0) 0x7fd39c03f930 con 0x7fd3a00a4b70 2020-04-02T23:49:38.279 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:38.279 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:37.572166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:clientreplay","state_seq":41,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 msgr2=0x7fd38004fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 0x7fd38004fa90 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fd394002f30 tx=0x7fd394007c20).stop 2020-04-02T23:49:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 msgr2=0x7fd3a00a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fd3a01363a0 tx=0x7fd39c0109a0).stop 2020-04-02T23:49:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 shutdown_connections 2020-04-02T23:49:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fd38004d5d0 0x7fd38004fa90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd3a0136870 0x7fd3a0147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 --2- 172.21.15.82:0/2326139369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a00a4b70 0x7fd3a00a19f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 >> 172.21.15.82:0/2326139369 conn(0x7fd3a009de60 msgr2=0x7fd3a0068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 shutdown_connections 2020-04-02T23:49:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:38.276+0000 7fd3a80b3700 1 -- 172.21.15.82:0/2326139369 wait complete. 2020-04-02T23:49:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2020-04-02T23:49:38.289 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-04-02T23:49:38.607 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/.snap/snap-subdir-test 2020-04-02T23:49:38.622 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/30 file after the snapshot 2020-04-02T23:49:38.624 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/31 file after the snapshot 2020-04-02T23:49:38.627 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/32 file after the snapshot 2020-04-02T23:49:38.630 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/33 file after the snapshot 2020-04-02T23:49:38.633 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/34 file after the snapshot 2020-04-02T23:49:38.637 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/35 file after the snapshot 2020-04-02T23:49:38.639 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/36 file after the snapshot 2020-04-02T23:49:38.642 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/37 file after the snapshot 2020-04-02T23:49:38.645 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/38 file after the snapshot 2020-04-02T23:49:38.647 INFO:tasks.workunit.client.0.smithi082.stdout: create 298/39 file after the snapshot 2020-04-02T23:49:38.650 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/.snap/snap-subdir-test 2020-04-02T23:49:38.666 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/30 file after the snapshot 2020-04-02T23:49:38.668 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/31 file after the snapshot 2020-04-02T23:49:38.670 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/32 file after the snapshot 2020-04-02T23:49:38.673 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/33 file after the snapshot 2020-04-02T23:49:38.676 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/34 file after the snapshot 2020-04-02T23:49:38.679 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/35 file after the snapshot 2020-04-02T23:49:38.682 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/36 file after the snapshot 2020-04-02T23:49:38.684 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/37 file after the snapshot 2020-04-02T23:49:38.687 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/38 file after the snapshot 2020-04-02T23:49:38.690 INFO:tasks.workunit.client.0.smithi082.stdout: create 299/39 file after the snapshot 2020-04-02T23:49:38.692 INFO:tasks.workunit.client.0.smithi082.stdout:Take second snapshot .snap/test2 2020-04-02T23:49:38.709 INFO:tasks.workunit.client.0.smithi082.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2020-04-02T23:49:40.291 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:40.305 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:40.458 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.455+0000 7f8972542700 1 Processor -- start 2020-04-02T23:49:40.458 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.455+0000 7f8972542700 1 -- start start 2020-04-02T23:49:40.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8972542700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:40.461 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8972542700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c0a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8972542700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0a5820 con 0x7f896c0a4b70 2020-04-02T23:49:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8972542700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c0a4130 con 0x7f896c0a2ab0 2020-04-02T23:49:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8972542700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c0a43d0 con 0x7f896c136870 2020-04-02T23:49:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c0a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c0a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55876/0 (socket says 172.21.15.82:55876) 2020-04-02T23:49:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 -- 172.21.15.82:0/3446357979 learned_addr learned my addr 172.21.15.82:0/3446357979 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f896b7fe700 1 --1- 172.21.15.82:0/3446357979 >> v1:172.21.15.82:6789/0 conn(0x7f896c0a4b70 0x7f896c136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55922/0 (socket says 172.21.15.82:55922) 2020-04-02T23:49:40.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f896bfff700 1 --2- 172.21.15.82:0/3446357979 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:40.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 -- 172.21.15.82:0/3446357979 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 msgr2=0x7f896c0aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:40.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 --2- 172.21.15.82:0/3446357979 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c0aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:40.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 -- 172.21.15.82:0/3446357979 >> v1:172.21.15.82:6789/0 conn(0x7f896c0a4b70 legacy=0x7f896c136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:40.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 -- 172.21.15.82:0/3446357979 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0a4670 con 0x7f896c136870 2020-04-02T23:49:40.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f896affd700 1 -- 172.21.15.82:0/3446357979 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541037834 0 0) 0x7f896c0a5820 con 0x7f896c0a4b70 2020-04-02T23:49:40.463 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.456+0000 7f8970adf700 1 --2- 172.21.15.82:0/3446357979 >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c0a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8970adf700 1 --2- 172.21.15.82:0/3446357979 >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c0a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8970adf700 1 --2- 172.21.15.82:0/3446357979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c0a4ff0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).ready entity=mon.1 client_cookie=bc10e2b880e8c0ee server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8970adf700 1 --2- 172.21.15.82:0/3446357979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c0a4ff0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f896affd700 1 -- 172.21.15.82:0/3446357979 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896400a160 con 0x7f896c136870 2020-04-02T23:49:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8970adf700 1 --2- 172.21.15.82:0/3446357979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c0a4ff0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f896affd700 1 -- 172.21.15.82:0/3446357979 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400a2c0 con 0x7f896c136870 2020-04-02T23:49:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8970adf700 1 --2- 172.21.15.82:0/3446357979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c0a4ff0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f896affd700 1 -- 172.21.15.82:0/3446357979 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896400a660 con 0x7f896c136870 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 -- 172.21.15.82:0/3446357979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 msgr2=0x7f896c0a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 --2- 172.21.15.82:0/3446357979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c0a4ff0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).stop 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 -- 172.21.15.82:0/3446357979 shutdown_connections 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 --2- 172.21.15.82:0/3446357979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c0a4ff0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 --2- 172.21.15.82:0/3446357979 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c0aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 -- 172.21.15.82:0/3446357979 >> 172.21.15.82:0/3446357979 conn(0x7f896c09de60 msgr2=0x7f896c09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:40.465 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 -- 172.21.15.82:0/3446357979 shutdown_connections 2020-04-02T23:49:40.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.457+0000 7f8972542700 1 -- 172.21.15.82:0/3446357979 wait complete. 2020-04-02T23:49:40.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.458+0000 7f8972542700 1 Processor -- start 2020-04-02T23:49:40.466 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.458+0000 7f8972542700 1 -- start start 2020-04-02T23:49:40.471 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8972542700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c09f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:40.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8972542700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f896c0a4b70 0x7f896c143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:40.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8972542700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c1436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:40.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8972542700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c066e80 con 0x7f896c0a2ab0 2020-04-02T23:49:40.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8972542700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c0a1410 con 0x7f896c136870 2020-04-02T23:49:40.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8972542700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0a16b0 con 0x7f896c0a4b70 2020-04-02T23:49:40.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c1436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:40.472 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c1436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55882/0 (socket says 172.21.15.82:55882) 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 -- 172.21.15.82:0/165089922 learned_addr learned my addr 172.21.15.82:0/165089922 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f896b7fe700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f896c0a4b70 0x7f896c143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f896bfff700 1 --2- 172.21.15.82:0/165089922 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c09f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 -- 172.21.15.82:0/165089922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f896c0a4b70 msgr2=0x7f896c143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f896c0a4b70 0x7f896c143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 -- 172.21.15.82:0/165089922 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 msgr2=0x7f896c09f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c09f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 -- 172.21.15.82:0/165089922 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0a1e60 con 0x7f896c136870 2020-04-02T23:49:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f896bfff700 1 --2- 172.21.15.82:0/165089922 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c09f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:49:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f896b7fe700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f896c0a4b70 0x7f896c143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:49:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> v2:172.21.15.82:3300/0 conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f89697fa700 1 -- 172.21.15.82:0/165089922 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8964005c30 con 0x7f896c136870 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.459+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.460+0000 7f89697fa700 1 -- 172.21.15.82:0/165089922 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964005d90 con 0x7f896c136870 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.460+0000 7f89697fa700 1 -- 172.21.15.82:0/165089922 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896400f760 con 0x7f896c136870 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.460+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c09f7a0 con 0x7f896c136870 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.460+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c0a1ae0 con 0x7f896c136870 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.460+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.475 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c09f930 con 0x7f896c136870 2020-04-02T23:49:40.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f89697fa700 1 -- 172.21.15.82:0/165089922 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f896400f9d0 con 0x7f896c136870 2020-04-02T23:49:40.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f89697fa700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 0x7f894c04faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:40.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f89697fa700 1 -- 172.21.15.82:0/165089922 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f8964061f30 con 0x7f896c136870 2020-04-02T23:49:40.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f896bfff700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 0x7f894c04faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:40.476 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f896bfff700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 0x7f894c04faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f895c002f30 tx=0x7f895c007d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f896bfff700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 0x7f894c04faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f895c002f30 tx=0x7f895c007d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.477 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.461+0000 7f896bfff700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 0x7f894c04faf0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f895c002f30 tx=0x7f895c007d10).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:40.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.464+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.478 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.464+0000 7f89697fa700 1 -- 172.21.15.82:0/165089922 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f896403d750 con 0x7f896c136870 2020-04-02T23:49:40.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.686+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f896c056c50 con 0x7f896c136870 2020-04-02T23:49:40.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.687+0000 7f8970adf700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:40.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.687+0000 7f89697fa700 1 -- 172.21.15.82:0/165089922 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1788 (secure 0 0 0) 0x7f8964040d70 con 0x7f896c136870 2020-04-02T23:49:40.700 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.688+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 msgr2=0x7f894c04faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:40.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.688+0000 7f8972542700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 0x7f894c04faf0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f895c002f30 tx=0x7f895c007d10).stop 2020-04-02T23:49:40.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.688+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 msgr2=0x7f896c1436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:40.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.688+0000 7f8972542700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7f89640032b0 tx=0x7f8964007dc0).stop 2020-04-02T23:49:40.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 shutdown_connections 2020-04-02T23:49:40.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f894c04d630 0x7f894c04faf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:40.701 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c136870 0x7f896c1436d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:40.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 --2- 172.21.15.82:0/165089922 >> v2:172.21.15.50:3300/0 conn(0x7f896c0a2ab0 0x7f896c09f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:40.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 --2- 172.21.15.82:0/165089922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f896c0a4b70 0x7f896c143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:40.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 >> 172.21.15.82:0/165089922 conn(0x7f896c09de60 msgr2=0x7f896c068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:40.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 shutdown_connections 2020-04-02T23:49:40.702 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:40.689+0000 7f8972542700 1 -- 172.21.15.82:0/165089922 wait complete. 2020-04-02T23:49:40.702 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2020-04-02T23:49:40.703 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:40.703 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:40.704 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=0, replacing gid=4390 2020-04-02T23:49:40.704 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 2 secs before reviving mds.a 2020-04-02T23:49:40.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2020-04-02T23:49:40.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2020-04-02T23:49:40.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2020-04-02T23:49:40.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2020-04-02T23:49:40.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2020-04-02T23:49:40.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2020-04-02T23:49:40.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2020-04-02T23:49:40.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2020-04-02T23:49:40.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2020-04-02T23:49:40.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2020-04-02T23:49:40.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2020-04-02T23:49:40.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2020-04-02T23:49:40.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2020-04-02T23:49:40.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2020-04-02T23:49:40.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2020-04-02T23:49:40.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2020-04-02T23:49:40.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2020-04-02T23:49:40.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2020-04-02T23:49:40.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2020-04-02T23:49:40.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2020-04-02T23:49:40.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2020-04-02T23:49:40.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2020-04-02T23:49:40.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2020-04-02T23:49:40.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2020-04-02T23:49:40.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2020-04-02T23:49:40.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2020-04-02T23:49:40.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2020-04-02T23:49:40.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2020-04-02T23:49:40.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2020-04-02T23:49:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2020-04-02T23:49:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2020-04-02T23:49:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2020-04-02T23:49:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2020-04-02T23:49:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2020-04-02T23:49:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2020-04-02T23:49:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2020-04-02T23:49:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2020-04-02T23:49:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2020-04-02T23:49:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2020-04-02T23:49:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2020-04-02T23:49:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2020-04-02T23:49:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2020-04-02T23:49:40.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2020-04-02T23:49:40.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2020-04-02T23:49:40.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2020-04-02T23:49:40.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2020-04-02T23:49:40.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2020-04-02T23:49:40.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2020-04-02T23:49:40.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2020-04-02T23:49:40.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2020-04-02T23:49:40.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2020-04-02T23:49:40.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2020-04-02T23:49:40.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2020-04-02T23:49:40.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2020-04-02T23:49:40.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2020-04-02T23:49:40.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2020-04-02T23:49:40.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2020-04-02T23:49:40.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2020-04-02T23:49:40.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2020-04-02T23:49:40.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2020-04-02T23:49:40.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2020-04-02T23:49:40.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2020-04-02T23:49:40.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2020-04-02T23:49:40.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2020-04-02T23:49:40.953 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2020-04-02T23:49:40.953 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2020-04-02T23:49:40.953 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2020-04-02T23:49:40.953 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2020-04-02T23:49:40.953 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2020-04-02T23:49:40.954 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2020-04-02T23:49:40.954 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2020-04-02T23:49:40.954 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2020-04-02T23:49:40.954 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2020-04-02T23:49:40.954 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2020-04-02T23:49:40.954 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2020-04-02T23:49:40.954 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2020-04-02T23:49:40.955 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2020-04-02T23:49:40.955 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2020-04-02T23:49:40.955 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2020-04-02T23:49:40.955 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2020-04-02T23:49:40.955 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2020-04-02T23:49:42.622 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2020-04-02T23:49:42.623 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2020-04-02T23:49:42.623 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2020-04-02T23:49:42.623 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2020-04-02T23:49:42.623 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2020-04-02T23:49:42.623 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2020-04-02T23:49:42.623 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2020-04-02T23:49:42.623 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2020-04-02T23:49:42.624 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2020-04-02T23:49:42.624 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2020-04-02T23:49:42.624 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2020-04-02T23:49:42.624 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2020-04-02T23:49:42.624 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2020-04-02T23:49:42.624 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2020-04-02T23:49:42.625 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2020-04-02T23:49:42.625 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2020-04-02T23:49:42.625 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2020-04-02T23:49:42.625 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2020-04-02T23:49:42.625 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2020-04-02T23:49:42.626 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2020-04-02T23:49:42.626 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2020-04-02T23:49:42.626 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2020-04-02T23:49:42.626 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2020-04-02T23:49:42.626 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2020-04-02T23:49:42.626 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2020-04-02T23:49:42.626 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2020-04-02T23:49:42.627 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2020-04-02T23:49:42.627 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2020-04-02T23:49:42.627 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2020-04-02T23:49:42.627 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2020-04-02T23:49:42.627 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2020-04-02T23:49:42.628 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2020-04-02T23:49:42.628 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2020-04-02T23:49:42.628 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2020-04-02T23:49:42.628 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2020-04-02T23:49:42.629 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2020-04-02T23:49:42.629 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2020-04-02T23:49:42.629 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2020-04-02T23:49:42.629 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2020-04-02T23:49:42.629 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2020-04-02T23:49:42.629 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2020-04-02T23:49:42.629 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2020-04-02T23:49:42.630 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2020-04-02T23:49:42.630 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2020-04-02T23:49:42.630 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2020-04-02T23:49:42.630 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2020-04-02T23:49:42.630 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2020-04-02T23:49:42.630 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2020-04-02T23:49:42.631 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2020-04-02T23:49:42.631 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2020-04-02T23:49:42.631 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2020-04-02T23:49:42.631 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2020-04-02T23:49:42.631 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2020-04-02T23:49:42.631 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2020-04-02T23:49:42.631 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2020-04-02T23:49:42.632 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2020-04-02T23:49:42.633 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2020-04-02T23:49:42.633 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2020-04-02T23:49:42.633 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2020-04-02T23:49:42.634 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2020-04-02T23:49:42.634 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2020-04-02T23:49:42.635 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2020-04-02T23:49:42.635 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2020-04-02T23:49:42.635 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2020-04-02T23:49:42.635 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2020-04-02T23:49:42.635 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2020-04-02T23:49:42.635 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2020-04-02T23:49:42.636 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2020-04-02T23:49:42.636 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2020-04-02T23:49:42.636 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2020-04-02T23:49:42.636 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2020-04-02T23:49:42.636 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2020-04-02T23:49:42.637 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2020-04-02T23:49:42.637 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2020-04-02T23:49:42.705 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2020-04-02T23:49:42.705 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-02T23:49:42.705 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:42.720 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-02T23:49:42.762 INFO:tasks.ceph.mds.a:Started 2020-04-02T23:49:42.763 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:42.776 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:42.834 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2020-04-02T23:49:42.923 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.921+0000 7f018bf6c700 1 Processor -- start 2020-04-02T23:49:42.924 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018bf6c700 1 -- start start 2020-04-02T23:49:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018bf6c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f018409e7d0 0x7f0184066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018bf6c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01840aaf20 0x7f01840ab390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018bf6c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01840675c0 con 0x7f018409e3f0 2020-04-02T23:49:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018bf6c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018413d100 con 0x7f01840aaf20 2020-04-02T23:49:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018bf6c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01840ab7f0 con 0x7f018409e7d0 2020-04-02T23:49:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018a509700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01840aaf20 0x7f01840ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:42.931 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018a509700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01840aaf20 0x7f01840ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55920/0 (socket says 172.21.15.82:55920) 2020-04-02T23:49:42.931 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.922+0000 7f018a509700 1 -- 172.21.15.82:0/2905544457 learned_addr learned my addr 172.21.15.82:0/2905544457 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:42.931 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f0189507700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f018409e7d0 0x7f0184066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:42.931 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 -- 172.21.15.82:0/2905544457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f018409e7d0 msgr2=0x7f0184066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:42.931 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f018409e7d0 0x7f0184066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:42.931 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 -- 172.21.15.82:0/2905544457 >> v1:172.21.15.82:6789/0 conn(0x7f018409e3f0 legacy=0x7f018413c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:42.931 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 -- 172.21.15.82:0/2905544457 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01840abc50 con 0x7f01840aaf20 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f0189507700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f018409e7d0 0x7f0184066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 --2- 172.21.15.82:0/2905544457 >> v2:172.21.15.82:3300/0 conn(0x7f01840aaf20 0x7f01840ab390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f017c0032b0 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 --2- 172.21.15.82:0/2905544457 >> v2:172.21.15.82:3300/0 conn(0x7f01840aaf20 0x7f01840ab390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f017c0032b0 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01840aaf20 0x7f01840ab390 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f017c0032b0 tx=0x7f017c007dc0).ready entity=mon.1 client_cookie=3ff2d0d3bd0d9e2d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01840aaf20 0x7f01840ab390 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f017c0032b0 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01840aaf20 0x7f01840ab390 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f017c0032b0 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018a509700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01840aaf20 0x7f01840ab390 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f017c0032b0 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.932 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f0188d06700 1 -- 172.21.15.82:0/2905544457 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f017c00a160 con 0x7f01840aaf20 2020-04-02T23:49:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f0188d06700 1 -- 172.21.15.82:0/2905544457 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00a2c0 con 0x7f01840aaf20 2020-04-02T23:49:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f0188d06700 1 -- 172.21.15.82:0/2905544457 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f017c00a6e0 con 0x7f01840aaf20 2020-04-02T23:49:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018bf6c700 1 -- 172.21.15.82:0/2905544457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01840aaf20 msgr2=0x7f01840ab390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018bf6c700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01840aaf20 0x7f01840ab390 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f017c0032b0 tx=0x7f017c007dc0).stop 2020-04-02T23:49:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018bf6c700 1 -- 172.21.15.82:0/2905544457 shutdown_connections 2020-04-02T23:49:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018bf6c700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01840aaf20 0x7f01840ab390 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018bf6c700 1 --2- 172.21.15.82:0/2905544457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f018409e7d0 0x7f0184066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:42.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.923+0000 7f018bf6c700 1 -- 172.21.15.82:0/2905544457 >> 172.21.15.82:0/2905544457 conn(0x7f01840abdf0 msgr2=0x7f01840ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:42.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.924+0000 7f018bf6c700 1 -- 172.21.15.82:0/2905544457 shutdown_connections 2020-04-02T23:49:42.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.924+0000 7f018bf6c700 1 -- 172.21.15.82:0/2905544457 wait complete. 2020-04-02T23:49:42.934 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.924+0000 7f018bf6c700 1 Processor -- start 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.924+0000 7f018bf6c700 1 -- start start 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f018bf6c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f018bf6c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0184146bf0 con 0x7f018409e3f0 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f018bf6c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01841336e0 con 0x7f01840aaf20 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f018bf6c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01841352d0 con 0x7f0184136250 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f0189507700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f01840aaf20 0x7f01840a86e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55978/0 (socket says 172.21.15.82:55978) 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f0189507700 1 -- 172.21.15.82:0/2731585045 learned_addr learned my addr 172.21.15.82:0/2731585045 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416081896 0 0) 0x7f01841336e0 con 0x7f01840aaf20 2020-04-02T23:49:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0164002fe0 con 0x7f01840aaf20 2020-04-02T23:49:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133612803 0 0) 0x7f0184146bf0 con 0x7f018409e3f0 2020-04-02T23:49:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.925+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01841336e0 con 0x7f018409e3f0 2020-04-02T23:49:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1995591082 0 0) 0x7f0164002fe0 con 0x7f01840aaf20 2020-04-02T23:49:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 -- 172.21.15.82:0/2731585045 >> v1:172.21.15.82:6789/0 conn(0x7f01840aaf20 legacy=0x7f01840a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 -- 172.21.15.82:0/2731585045 >> v1:172.21.15.50:6789/0 conn(0x7f018409e3f0 legacy=0x7f01841464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 -- 172.21.15.82:0/2731585045 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184134250 con 0x7f0184136250 2020-04-02T23:49:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01780026d0 con 0x7f0184136250 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00a780 con 0x7f0184136250 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01841346f0 con 0x7f0184136250 2020-04-02T23:49:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f017c011e20 con 0x7f0184136250 2020-04-02T23:49:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.926+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018413bf40 con 0x7f0184136250 2020-04-02T23:49:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f017c005c30 con 0x7f0184136250 2020-04-02T23:49:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0184135f30 con 0x7f0184136250 2020-04-02T23:49:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f0176ffd700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 0x7f016404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f017c061490 con 0x7f0184136250 2020-04-02T23:49:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f0189d08700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 0x7f016404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.927+0000 7f0189d08700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 0x7f016404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0180000fe0 tx=0x7f0180002700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.928+0000 7f0189d08700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 0x7f016404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0180000fe0 tx=0x7f0180002700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.928+0000 7f0189d08700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 0x7f016404fe80 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f0180000fe0 tx=0x7f0180002700).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.931+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:42.931+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f017c03cc90 con 0x7f0184136250 2020-04-02T23:49:43.118 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.116+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01840abc50 con 0x7f0184136250 2020-04-02T23:49:43.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.117+0000 7f018a509700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:43.119 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.117+0000 7f0176ffd700 1 -- 172.21.15.82:0/2731585045 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1788 (secure 0 0 0) 0x7f01840abc50 con 0x7f0184136250 2020-04-02T23:49:43.119 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:43.119 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:43.120 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 msgr2=0x7f016404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:43.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 0x7f016404fe80 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f0180000fe0 tx=0x7f0180002700).stop 2020-04-02T23:49:43.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 msgr2=0x7f0184151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:43.121 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f0184133600 tx=0x7f017c007dc0).stop 2020-04-02T23:49:43.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 shutdown_connections 2020-04-02T23:49:43.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0184136250 0x7f0184151d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:43.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 --2- 172.21.15.82:0/2731585045 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f016404d9c0 0x7f016404fe80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:43.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 >> 172.21.15.82:0/2731585045 conn(0x7f01840abdf0 msgr2=0x7f0184068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:43.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 shutdown_connections 2020-04-02T23:49:43.122 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:43.118+0000 7f018bf6c700 1 -- 172.21.15.82:0/2731585045 wait complete. 2020-04-02T23:49:43.122 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2020-04-02T23:49:43.130 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2020-04-02T23:49:45.131 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:45.146 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:45.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.291+0000 7f4d33835700 1 Processor -- start 2020-04-02T23:49:45.293 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.291+0000 7f4d33835700 1 -- start start 2020-04-02T23:49:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.291+0000 7f4d33835700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d33835700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c136870 0x7f4d2c0a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d33835700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c0a5820 con 0x7f4d2c0a4b70 2020-04-02T23:49:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d33835700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0a4130 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d33835700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0a43d0 con 0x7f4d2c136870 2020-04-02T23:49:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d31dd2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c136870 0x7f4d2c0a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d30dd0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d2c0a4b70 0x7f4d2c136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:59962/0 (socket says 172.21.15.82:59962) 2020-04-02T23:49:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d30dd0700 1 -- 172.21.15.82:0/885627222 learned_addr learned my addr 172.21.15.82:0/885627222 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 -- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c136870 msgr2=0x7f4d2c0a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c136870 0x7f4d2c0a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 -- 172.21.15.82:0/885627222 >> v1:172.21.15.50:6789/0 conn(0x7f4d2c0a4b70 legacy=0x7f4d2c136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 -- 172.21.15.82:0/885627222 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0a4670 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d1ffff700 1 -- 172.21.15.82:0/885627222 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994894941 0 0) 0x7f4d2c0a5820 con 0x7f4d2c0a4b70 2020-04-02T23:49:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 --2- 172.21.15.82:0/885627222 >> v2:172.21.15.50:3300/0 conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 --2- 172.21.15.82:0/885627222 >> v2:172.21.15.50:3300/0 conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.292+0000 7f4d315d1700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).ready entity=mon.0 client_cookie=66b985e421261185 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d315d1700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d1ffff700 1 -- 172.21.15.82:0/885627222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d24011e20 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d315d1700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d315d1700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d1ffff700 1 -- 172.21.15.82:0/885627222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400a160 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d1ffff700 1 -- 172.21.15.82:0/885627222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d2400a540 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 -- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0a2ab0 msgr2=0x7f4d2c0aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).stop 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 -- 172.21.15.82:0/885627222 shutdown_connections 2020-04-02T23:49:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c136870 0x7f4d2c0a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 --2- 172.21.15.82:0/885627222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0aae80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 -- 172.21.15.82:0/885627222 >> 172.21.15.82:0/885627222 conn(0x7f4d2c09de60 msgr2=0x7f4d2c09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 -- 172.21.15.82:0/885627222 shutdown_connections 2020-04-02T23:49:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.293+0000 7f4d33835700 1 -- 172.21.15.82:0/885627222 wait complete. 2020-04-02T23:49:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.294+0000 7f4d33835700 1 Processor -- start 2020-04-02T23:49:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.294+0000 7f4d33835700 1 -- start start 2020-04-02T23:49:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d33835700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d33835700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d2c136870 0x7f4d2c0a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d33835700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c061650 con 0x7f4d2c0a4b70 2020-04-02T23:49:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d33835700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c062570 con 0x7f4d2c136870 2020-04-02T23:49:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d33835700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0a1950 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d30dd0700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4d2c0a4b70 0x7f4d2c1466d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55998/0 (socket says 172.21.15.82:55998) 2020-04-02T23:49:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d30dd0700 1 -- 172.21.15.82:0/1912055636 learned_addr learned my addr 172.21.15.82:0/1912055636 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d31dd2700 1 --2- 172.21.15.82:0/1912055636 >> v2:172.21.15.50:3300/0 conn(0x7f4d2c136870 0x7f4d2c0a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982360497 0 0) 0x7f4d2c061650 con 0x7f4d2c0a4b70 2020-04-02T23:49:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d0c002fe0 con 0x7f4d2c0a4b70 2020-04-02T23:49:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 -- 172.21.15.82:0/1912055636 >> v2:172.21.15.50:3300/0 conn(0x7f4d2c136870 msgr2=0x7f4d2c0a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> v2:172.21.15.50:3300/0 conn(0x7f4d2c136870 0x7f4d2c0a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 -- 172.21.15.82:0/1912055636 >> v1:172.21.15.82:6789/0 conn(0x7f4d2c0a4b70 legacy=0x7f4d2c1466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 -- 172.21.15.82:0/1912055636 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0a1bf0 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d31dd2700 1 --2- 172.21.15.82:0/1912055636 >> v2:172.21.15.50:3300/0 conn(0x7f4d2c136870 0x7f4d2c0a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:49:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d24005c30 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d24005d90 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c066690 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.295+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d24007340 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.296+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c061a80 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.296+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.296+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4d240075b0 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.296+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.297+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c056c50 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.297+0000 7f4d1e7fc700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 0x7f4d0c04fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.297+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f4d24061be0 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.297+0000 7f4d30dd0700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 0x7f4d0c04fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.297+0000 7f4d30dd0700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 0x7f4d0c04fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d20001080 tx=0x7f4d200016d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.297+0000 7f4d30dd0700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 0x7f4d0c04fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d20001080 tx=0x7f4d200016d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.297+0000 7f4d30dd0700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 0x7f4d0c04fe30 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f4d20001080 tx=0x7f4d200016d0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.300+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.311 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.300+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4d2403d400 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.483+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d2c05d150 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.483+0000 7f4d315d1700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.483+0000 7f4d1e7fc700 1 -- 172.21.15.82:0/1912055636 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1788 (secure 0 0 0) 0x7f4d24040a20 con 0x7f4d2c0a2ab0 2020-04-02T23:49:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 msgr2=0x7f4d0c04fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 0x7f4d0c04fe30 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f4d20001080 tx=0x7f4d200016d0).stop 2020-04-02T23:49:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 msgr2=0x7f4d2c0a1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f4d240032b0 tx=0x7f4d24007dc0).stop 2020-04-02T23:49:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 shutdown_connections 2020-04-02T23:49:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 --2- 172.21.15.82:0/1912055636 >> v2:172.21.15.50:3300/0 conn(0x7f4d2c136870 0x7f4d2c0a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4d2c0a2ab0 0x7f4d2c0a1060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 --2- 172.21.15.82:0/1912055636 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f4d0c04d970 0x7f4d0c04fe30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 >> 172.21.15.82:0/1912055636 conn(0x7f4d2c09de60 msgr2=0x7f4d2c068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 shutdown_connections 2020-04-02T23:49:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:45.485+0000 7f4d33835700 1 -- 172.21.15.82:0/1912055636 wait complete. 2020-04-02T23:49:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2020-04-02T23:49:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:45.493 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:45.497 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2020-04-02T23:49:45.926 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2020-04-02T23:49:45.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2020-04-02T23:49:45.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2020-04-02T23:49:45.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2020-04-02T23:49:45.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2020-04-02T23:49:45.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2020-04-02T23:49:45.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2020-04-02T23:49:45.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2020-04-02T23:49:45.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2020-04-02T23:49:45.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2020-04-02T23:49:45.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2020-04-02T23:49:45.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2020-04-02T23:49:45.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2020-04-02T23:49:45.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2020-04-02T23:49:45.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2020-04-02T23:49:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2020-04-02T23:49:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2020-04-02T23:49:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2020-04-02T23:49:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2020-04-02T23:49:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2020-04-02T23:49:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2020-04-02T23:49:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2020-04-02T23:49:45.930 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2020-04-02T23:49:45.930 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2020-04-02T23:49:45.930 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2020-04-02T23:49:45.930 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2020-04-02T23:49:45.930 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2020-04-02T23:49:45.931 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2020-04-02T23:49:45.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2020-04-02T23:49:45.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2020-04-02T23:49:45.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2020-04-02T23:49:45.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2020-04-02T23:49:45.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2020-04-02T23:49:45.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2020-04-02T23:49:45.932 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2020-04-02T23:49:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2020-04-02T23:49:45.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2020-04-02T23:49:45.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2020-04-02T23:49:45.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2020-04-02T23:49:45.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2020-04-02T23:49:45.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2020-04-02T23:49:45.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2020-04-02T23:49:45.934 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2020-04-02T23:49:45.935 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2020-04-02T23:49:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2020-04-02T23:49:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2020-04-02T23:49:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2020-04-02T23:49:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2020-04-02T23:49:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2020-04-02T23:49:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2020-04-02T23:49:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2020-04-02T23:49:45.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2020-04-02T23:49:45.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2020-04-02T23:49:47.498 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:47.512 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:49:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.660+0000 7f638af51700 1 Processor -- start 2020-04-02T23:49:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.660+0000 7f638af51700 1 -- start start 2020-04-02T23:49:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f638af51700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63840a8480 0x7f63840a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f638af51700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f638405b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:49:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f638af51700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63840a3a40 con 0x7f638405b470 2020-04-02T23:49:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f638af51700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840a3ce0 con 0x7f63840a6a00 2020-04-02T23:49:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f638af51700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840a4890 con 0x7f63840a8480 2020-04-02T23:49:47.666 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63840a8480 0x7f63840a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:47.666 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63840a8480 0x7f63840a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55970/0 (socket says 172.21.15.82:55970) 2020-04-02T23:49:47.666 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 -- 172.21.15.82:0/3335503108 learned_addr learned my addr 172.21.15.82:0/3335503108 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:49:47.666 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6383fff700 1 --2- 172.21.15.82:0/3335503108 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f638405b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 -- 172.21.15.82:0/3335503108 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 msgr2=0x7f638405b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:49:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- 172.21.15.82:0/3335503108 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f638405b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 -- 172.21.15.82:0/3335503108 >> v1:172.21.15.82:6789/0 conn(0x7f638405b470 legacy=0x7f638405b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 -- 172.21.15.82:0/3335503108 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63840a4e10 con 0x7f63840a8480 2020-04-02T23:49:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6383fff700 1 --2- 172.21.15.82:0/3335503108 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f638405b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:49:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- 172.21.15.82:0/3335503108 >> v2:172.21.15.82:3300/0 conn(0x7f63840a8480 0x7f63840a4110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- 172.21.15.82:0/3335503108 >> v2:172.21.15.82:3300/0 conn(0x7f63840a8480 0x7f63840a4110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- 172.21.15.82:0/3335503108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63840a8480 0x7f63840a4110 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).ready entity=mon.1 client_cookie=1ca519b443e12ab6 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- 172.21.15.82:0/3335503108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63840a8480 0x7f63840a4110 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f6388ced700 1 --2- 172.21.15.82:0/3335503108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63840a8480 0x7f63840a4110 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.661+0000 7f63837fe700 1 -- 172.21.15.82:0/3335503108 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f637c00a160 con 0x7f63840a8480 2020-04-02T23:49:47.679 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f6388ced700 1 --2- 172.21.15.82:0/3335503108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63840a8480 0x7f63840a4110 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.679 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f63837fe700 1 -- 172.21.15.82:0/3335503108 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c00a2c0 con 0x7f63840a8480 2020-04-02T23:49:47.679 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f63837fe700 1 -- 172.21.15.82:0/3335503108 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f637c00a660 con 0x7f63840a8480 2020-04-02T23:49:47.680 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 -- 172.21.15.82:0/3335503108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63840a8480 msgr2=0x7f63840a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:47.680 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 --2- 172.21.15.82:0/3335503108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63840a8480 0x7f63840a4110 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).stop 2020-04-02T23:49:47.680 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 -- 172.21.15.82:0/3335503108 shutdown_connections 2020-04-02T23:49:47.680 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 --2- 172.21.15.82:0/3335503108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63840a8480 0x7f63840a4110 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:47.681 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 --2- 172.21.15.82:0/3335503108 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f638405b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:49:47.681 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 -- 172.21.15.82:0/3335503108 >> 172.21.15.82:0/3335503108 conn(0x7f638409e8e0 msgr2=0x7f63840a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:47.681 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 -- 172.21.15.82:0/3335503108 shutdown_connections 2020-04-02T23:49:47.681 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.662+0000 7f638af51700 1 -- 172.21.15.82:0/3335503108 wait complete. 2020-04-02T23:49:47.681 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.663+0000 7f638af51700 1 Processor -- start 2020-04-02T23:49:47.682 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.663+0000 7f638af51700 1 -- start start 2020-04-02T23:49:47.682 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f638af51700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:47.682 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f638af51700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f6384144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:47.682 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f638af51700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6384061a50 con 0x7f63840a8480 2020-04-02T23:49:47.682 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f638af51700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6384144330 con 0x7f63840a6a00 2020-04-02T23:49:47.683 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f638af51700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63841445d0 con 0x7f638405b470 2020-04-02T23:49:47.683 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f63894ee700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f63840a8480 0x7f63841311e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56030/0 (socket says 172.21.15.82:56030) 2020-04-02T23:49:47.683 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f63894ee700 1 -- 172.21.15.82:0/2296181392 learned_addr learned my addr 172.21.15.82:0/2296181392 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:49:47.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:47.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6383fff700 1 --2- 172.21.15.82:0/2296181392 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f6384144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:47.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007864311 0 0) 0x7f63840a3a40 con 0x7f63840a8480 2020-04-02T23:49:47.684 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6364002fe0 con 0x7f63840a8480 2020-04-02T23:49:47.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6388ced700 1 -- 172.21.15.82:0/2296181392 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 msgr2=0x7f6384144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:47.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f6384144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:47.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6388ced700 1 -- 172.21.15.82:0/2296181392 >> v1:172.21.15.82:6789/0 conn(0x7f63840a8480 legacy=0x7f63841311e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:47.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6388ced700 1 -- 172.21.15.82:0/2296181392 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384061c90 con 0x7f638405b470 2020-04-02T23:49:47.685 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.664+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:47.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f637c005a40 con 0x7f638405b470 2020-04-02T23:49:47.686 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c005ba0 con 0x7f638405b470 2020-04-02T23:49:47.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63840a1070 con 0x7f638405b470 2020-04-02T23:49:47.687 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f637c007150 con 0x7f638405b470 2020-04-02T23:49:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.665+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63841359c0 con 0x7f638405b470 2020-04-02T23:49:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.666+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.666+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6384056c50 con 0x7f638405b470 2020-04-02T23:49:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.666+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f637c007350 con 0x7f638405b470 2020-04-02T23:49:47.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.666+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.666+0000 7f6381ffb700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 0x7f636404fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:49:47.689 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.666+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f637c061b70 con 0x7f638405b470 2020-04-02T23:49:47.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.667+0000 7f6383fff700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 0x7f636404fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:49:47.690 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.667+0000 7f6383fff700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 0x7f636404fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6378002f30 tx=0x7f6378007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.667+0000 7f6383fff700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 0x7f636404fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6378002f30 tx=0x7f6378007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.667+0000 7f6383fff700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 0x7f636404fda0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f6378002f30 tx=0x7f6378007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:49:47.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.670+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.691 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.670+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f637c03d370 con 0x7f638405b470 2020-04-02T23:49:47.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.857+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6384066770 con 0x7f638405b470 2020-04-02T23:49:47.864 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.858+0000 7f6388ced700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:49:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.858+0000 7f6381ffb700 1 -- 172.21.15.82:0/2296181392 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f637c040990 con 0x7f638405b470 2020-04-02T23:49:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 msgr2=0x7f636404fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 0x7f636404fda0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f6378002f30 tx=0x7f6378007a40).stop 2020-04-02T23:49:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 msgr2=0x7f63840615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:49:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f637c0032b0 tx=0x7f637c007dc0).stop 2020-04-02T23:49:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 shutdown_connections 2020-04-02T23:49:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f636404d8e0 0x7f636404fda0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 --2- 172.21.15.82:0/2296181392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f638405b470 0x7f63840615f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 --2- 172.21.15.82:0/2296181392 >> v2:172.21.15.50:3300/0 conn(0x7f63840a6a00 0x7f6384144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:49:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 >> 172.21.15.82:0/2296181392 conn(0x7f638409e8e0 msgr2=0x7f6384133640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:49:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 shutdown_connections 2020-04-02T23:49:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:49:47.859+0000 7f638af51700 1 -- 172.21.15.82:0/2296181392 wait complete. 2020-04-02T23:49:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2020-04-02T23:49:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:49:47.876 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.82:6835/1743311703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1743311703},{"type":"v1","addr":"172.21.15.82:6835","nonce":1743311703}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:49:47.878 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2020-04-02T23:49:47.878 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 81 secs before thrashing 2020-04-02T23:49:50.912 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2020-04-02T23:49:50.913 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2020-04-02T23:49:50.913 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2020-04-02T23:49:50.913 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2020-04-02T23:49:50.913 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2020-04-02T23:49:50.913 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2020-04-02T23:49:50.913 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2020-04-02T23:49:50.914 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2020-04-02T23:49:50.914 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2020-04-02T23:49:50.914 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2020-04-02T23:49:50.914 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2020-04-02T23:49:50.914 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2020-04-02T23:49:50.914 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2020-04-02T23:49:50.914 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2020-04-02T23:49:50.915 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2020-04-02T23:49:50.915 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2020-04-02T23:49:50.915 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2020-04-02T23:49:50.915 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2020-04-02T23:49:50.915 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2020-04-02T23:49:50.915 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2020-04-02T23:49:50.916 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2020-04-02T23:49:50.916 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2020-04-02T23:49:50.916 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2020-04-02T23:49:50.916 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2020-04-02T23:49:50.916 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2020-04-02T23:49:50.916 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2020-04-02T23:49:50.917 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2020-04-02T23:49:50.917 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2020-04-02T23:49:50.917 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2020-04-02T23:49:50.917 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2020-04-02T23:49:50.917 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2020-04-02T23:49:50.917 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2020-04-02T23:49:50.917 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2020-04-02T23:49:50.918 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2020-04-02T23:49:50.918 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2020-04-02T23:49:50.918 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2020-04-02T23:49:50.918 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2020-04-02T23:49:50.918 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2020-04-02T23:49:50.918 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2020-04-02T23:49:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2020-04-02T23:49:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2020-04-02T23:49:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2020-04-02T23:49:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2020-04-02T23:49:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2020-04-02T23:49:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2020-04-02T23:49:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2020-04-02T23:49:50.920 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2020-04-02T23:49:50.920 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2020-04-02T23:49:50.920 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2020-04-02T23:49:50.920 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2020-04-02T23:49:50.920 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2020-04-02T23:49:50.920 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2020-04-02T23:49:50.920 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2020-04-02T23:49:50.921 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2020-04-02T23:49:50.921 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2020-04-02T23:49:50.921 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2020-04-02T23:49:50.921 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2020-04-02T23:49:50.921 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2020-04-02T23:49:50.921 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2020-04-02T23:49:50.922 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2020-04-02T23:49:50.922 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2020-04-02T23:49:50.922 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2020-04-02T23:49:50.922 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2020-04-02T23:49:50.922 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2020-04-02T23:49:50.922 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2020-04-02T23:49:50.922 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2020-04-02T23:49:50.923 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2020-04-02T23:49:50.923 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2020-04-02T23:49:50.923 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2020-04-02T23:49:50.923 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2020-04-02T23:49:50.923 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2020-04-02T23:49:50.923 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2020-04-02T23:49:50.924 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2020-04-02T23:49:50.924 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2020-04-02T23:49:50.924 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2020-04-02T23:49:50.924 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2020-04-02T23:49:50.924 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2020-04-02T23:49:50.924 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2020-04-02T23:49:50.924 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2020-04-02T23:49:50.925 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2020-04-02T23:49:50.925 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2020-04-02T23:49:52.698 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2020-04-02T23:49:52.698 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2020-04-02T23:49:52.698 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2020-04-02T23:49:52.699 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2020-04-02T23:49:52.699 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2020-04-02T23:49:52.699 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2020-04-02T23:49:52.699 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2020-04-02T23:49:52.699 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2020-04-02T23:49:52.699 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2020-04-02T23:49:52.699 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2020-04-02T23:49:52.700 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2020-04-02T23:49:52.700 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2020-04-02T23:49:52.700 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2020-04-02T23:49:52.700 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2020-04-02T23:49:52.700 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2020-04-02T23:49:52.700 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2020-04-02T23:49:52.700 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2020-04-02T23:49:52.701 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2020-04-02T23:49:52.701 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2020-04-02T23:49:52.701 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2020-04-02T23:49:52.701 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2020-04-02T23:49:52.701 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2020-04-02T23:49:52.701 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2020-04-02T23:49:52.701 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2020-04-02T23:49:52.702 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2020-04-02T23:49:52.702 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2020-04-02T23:49:52.702 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2020-04-02T23:49:52.702 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2020-04-02T23:49:52.702 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2020-04-02T23:49:52.702 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2020-04-02T23:49:52.702 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2020-04-02T23:49:52.703 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2020-04-02T23:49:52.703 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2020-04-02T23:49:52.703 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2020-04-02T23:49:52.703 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2020-04-02T23:49:52.703 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2020-04-02T23:49:52.703 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2020-04-02T23:49:52.703 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2020-04-02T23:49:52.704 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2020-04-02T23:49:52.704 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2020-04-02T23:49:52.704 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2020-04-02T23:49:52.704 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2020-04-02T23:49:52.704 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2020-04-02T23:49:52.704 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2020-04-02T23:49:52.704 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2020-04-02T23:49:52.705 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2020-04-02T23:49:52.705 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2020-04-02T23:49:52.705 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2020-04-02T23:49:52.705 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2020-04-02T23:49:52.705 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2020-04-02T23:49:52.705 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2020-04-02T23:49:52.705 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2020-04-02T23:49:52.706 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2020-04-02T23:49:52.706 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2020-04-02T23:49:52.706 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2020-04-02T23:49:52.706 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2020-04-02T23:49:52.706 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2020-04-02T23:49:52.706 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2020-04-02T23:49:52.706 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2020-04-02T23:49:52.707 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2020-04-02T23:49:52.707 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2020-04-02T23:49:52.707 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2020-04-02T23:49:52.707 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2020-04-02T23:49:52.707 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2020-04-02T23:49:52.707 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2020-04-02T23:49:52.707 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2020-04-02T23:49:52.708 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2020-04-02T23:49:52.708 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2020-04-02T23:49:52.708 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2020-04-02T23:49:52.708 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2020-04-02T23:49:52.708 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2020-04-02T23:49:52.708 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2020-04-02T23:49:52.708 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2020-04-02T23:49:52.709 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2020-04-02T23:49:52.709 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2020-04-02T23:49:52.709 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2020-04-02T23:49:52.709 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2020-04-02T23:49:52.709 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2020-04-02T23:49:52.709 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2020-04-02T23:49:52.709 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2020-04-02T23:49:52.710 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2020-04-02T23:49:55.750 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:49:55.768 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:55.810 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:49:55.827 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:57.393 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2020-04-02T23:49:57.393 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2020-04-02T23:49:57.394 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2020-04-02T23:49:57.394 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2020-04-02T23:49:57.394 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2020-04-02T23:49:57.394 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2020-04-02T23:49:57.394 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2020-04-02T23:49:57.394 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2020-04-02T23:49:57.394 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2020-04-02T23:49:57.395 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2020-04-02T23:49:57.396 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2020-04-02T23:49:57.396 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2020-04-02T23:49:57.396 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2020-04-02T23:49:57.396 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2020-04-02T23:49:57.396 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2020-04-02T23:49:57.396 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2020-04-02T23:49:57.396 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2020-04-02T23:49:57.397 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2020-04-02T23:49:57.398 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2020-04-02T23:49:57.399 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2020-04-02T23:49:57.399 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2020-04-02T23:49:57.399 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2020-04-02T23:49:57.399 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2020-04-02T23:49:57.399 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2020-04-02T23:49:57.399 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2020-04-02T23:49:57.399 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2020-04-02T23:49:57.400 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2020-04-02T23:49:57.400 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2020-04-02T23:49:57.400 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2020-04-02T23:49:57.400 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2020-04-02T23:49:57.400 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2020-04-02T23:49:57.400 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2020-04-02T23:49:57.400 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2020-04-02T23:49:57.401 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2020-04-02T23:49:57.401 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2020-04-02T23:49:57.401 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2020-04-02T23:49:57.401 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2020-04-02T23:49:57.401 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2020-04-02T23:49:57.401 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2020-04-02T23:49:57.401 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2020-04-02T23:49:57.402 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2020-04-02T23:49:57.403 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2020-04-02T23:49:57.403 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2020-04-02T23:49:57.403 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2020-04-02T23:49:57.403 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2020-04-02T23:49:57.403 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2020-04-02T23:49:57.403 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2020-04-02T23:49:57.403 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2020-04-02T23:49:57.404 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2020-04-02T23:49:57.404 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2020-04-02T23:49:57.404 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2020-04-02T23:49:57.404 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2020-04-02T23:49:57.404 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2020-04-02T23:50:01.050 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2020-04-02T23:50:01.050 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2020-04-02T23:50:01.050 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2020-04-02T23:50:01.051 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2020-04-02T23:50:01.051 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2020-04-02T23:50:01.051 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2020-04-02T23:50:01.051 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2020-04-02T23:50:01.051 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2020-04-02T23:50:01.051 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2020-04-02T23:50:01.051 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2020-04-02T23:50:01.052 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2020-04-02T23:50:01.053 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2020-04-02T23:50:01.053 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2020-04-02T23:50:01.053 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2020-04-02T23:50:01.053 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2020-04-02T23:50:01.053 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2020-04-02T23:50:01.053 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2020-04-02T23:50:01.053 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2020-04-02T23:50:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2020-04-02T23:50:01.055 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2020-04-02T23:50:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2020-04-02T23:50:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2020-04-02T23:50:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2020-04-02T23:50:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2020-04-02T23:50:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2020-04-02T23:50:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2020-04-02T23:50:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2020-04-02T23:50:01.057 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2020-04-02T23:50:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2020-04-02T23:50:01.059 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2020-04-02T23:50:01.060 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2020-04-02T23:50:01.060 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2020-04-02T23:50:01.060 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2020-04-02T23:50:01.060 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2020-04-02T23:50:01.060 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2020-04-02T23:50:01.061 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2020-04-02T23:50:01.061 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2020-04-02T23:50:01.061 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2020-04-02T23:50:01.061 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2020-04-02T23:50:01.061 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2020-04-02T23:50:05.568 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2020-04-02T23:50:05.568 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2020-04-02T23:50:05.568 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2020-04-02T23:50:05.568 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2020-04-02T23:50:05.569 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2020-04-02T23:50:05.569 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2020-04-02T23:50:05.569 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2020-04-02T23:50:05.569 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2020-04-02T23:50:05.569 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2020-04-02T23:50:05.570 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2020-04-02T23:50:05.570 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2020-04-02T23:50:05.570 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2020-04-02T23:50:05.570 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2020-04-02T23:50:05.570 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2020-04-02T23:50:05.571 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2020-04-02T23:50:05.571 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2020-04-02T23:50:05.571 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2020-04-02T23:50:05.571 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2020-04-02T23:50:05.571 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2020-04-02T23:50:05.572 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2020-04-02T23:50:05.572 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2020-04-02T23:50:05.572 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2020-04-02T23:50:05.572 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2020-04-02T23:50:05.572 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2020-04-02T23:50:05.573 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2020-04-02T23:50:05.573 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2020-04-02T23:50:05.573 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2020-04-02T23:50:05.573 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2020-04-02T23:50:05.573 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2020-04-02T23:50:05.574 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2020-04-02T23:50:05.574 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2020-04-02T23:50:05.574 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2020-04-02T23:50:05.574 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2020-04-02T23:50:05.574 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2020-04-02T23:50:05.574 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2020-04-02T23:50:05.575 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2020-04-02T23:50:05.575 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2020-04-02T23:50:05.575 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2020-04-02T23:50:05.575 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2020-04-02T23:50:05.575 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2020-04-02T23:50:05.576 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2020-04-02T23:50:05.576 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2020-04-02T23:50:05.577 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2020-04-02T23:50:05.577 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2020-04-02T23:50:05.577 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2020-04-02T23:50:05.577 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2020-04-02T23:50:05.577 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2020-04-02T23:50:05.578 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2020-04-02T23:50:05.578 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2020-04-02T23:50:05.578 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2020-04-02T23:50:05.579 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2020-04-02T23:50:05.579 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2020-04-02T23:50:05.579 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2020-04-02T23:50:05.579 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2020-04-02T23:50:05.579 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2020-04-02T23:50:05.580 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2020-04-02T23:50:05.580 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2020-04-02T23:50:05.580 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2020-04-02T23:50:05.580 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2020-04-02T23:50:05.580 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2020-04-02T23:50:05.581 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2020-04-02T23:50:05.581 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2020-04-02T23:50:05.581 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2020-04-02T23:50:05.581 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2020-04-02T23:50:05.581 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2020-04-02T23:50:05.582 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2020-04-02T23:50:05.582 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2020-04-02T23:50:05.582 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2020-04-02T23:50:05.582 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2020-04-02T23:50:05.582 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2020-04-02T23:50:05.583 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2020-04-02T23:50:05.583 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2020-04-02T23:50:05.583 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2020-04-02T23:50:05.583 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2020-04-02T23:50:05.583 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2020-04-02T23:50:05.584 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2020-04-02T23:50:05.584 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2020-04-02T23:50:05.584 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2020-04-02T23:50:05.584 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2020-04-02T23:50:05.584 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2020-04-02T23:50:05.584 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2020-04-02T23:50:09.873 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2020-04-02T23:50:09.873 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2020-04-02T23:50:09.873 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2020-04-02T23:50:09.873 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2020-04-02T23:50:09.874 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2020-04-02T23:50:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2020-04-02T23:50:09.876 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2020-04-02T23:50:09.876 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2020-04-02T23:50:09.876 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2020-04-02T23:50:09.876 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2020-04-02T23:50:09.876 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2020-04-02T23:50:09.876 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2020-04-02T23:50:09.876 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2020-04-02T23:50:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2020-04-02T23:50:09.878 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2020-04-02T23:50:09.878 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2020-04-02T23:50:09.878 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2020-04-02T23:50:09.878 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2020-04-02T23:50:09.878 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2020-04-02T23:50:09.878 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2020-04-02T23:50:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2020-04-02T23:50:09.880 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2020-04-02T23:50:09.880 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2020-04-02T23:50:09.880 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2020-04-02T23:50:09.880 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2020-04-02T23:50:09.880 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2020-04-02T23:50:09.880 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2020-04-02T23:50:09.881 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2020-04-02T23:50:09.881 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2020-04-02T23:50:09.881 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2020-04-02T23:50:09.881 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2020-04-02T23:50:09.881 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2020-04-02T23:50:09.882 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2020-04-02T23:50:09.882 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2020-04-02T23:50:09.882 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2020-04-02T23:50:09.882 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2020-04-02T23:50:09.882 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2020-04-02T23:50:09.882 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2020-04-02T23:50:09.882 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2020-04-02T23:50:09.883 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2020-04-02T23:50:09.884 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2020-04-02T23:50:09.884 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2020-04-02T23:50:09.884 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2020-04-02T23:50:09.884 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2020-04-02T23:50:09.884 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2020-04-02T23:50:09.884 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2020-04-02T23:50:16.229 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2020-04-02T23:50:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2020-04-02T23:50:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2020-04-02T23:50:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2020-04-02T23:50:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2020-04-02T23:50:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2020-04-02T23:50:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2020-04-02T23:50:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2020-04-02T23:50:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2020-04-02T23:50:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2020-04-02T23:50:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2020-04-02T23:50:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2020-04-02T23:50:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2020-04-02T23:50:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2020-04-02T23:50:16.232 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2020-04-02T23:50:16.232 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2020-04-02T23:50:16.232 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2020-04-02T23:50:16.232 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2020-04-02T23:50:16.232 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2020-04-02T23:50:16.232 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2020-04-02T23:50:16.233 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2020-04-02T23:50:16.233 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2020-04-02T23:50:16.233 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2020-04-02T23:50:16.233 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2020-04-02T23:50:16.239 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2020-04-02T23:50:16.239 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2020-04-02T23:50:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2020-04-02T23:50:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2020-04-02T23:50:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2020-04-02T23:50:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2020-04-02T23:50:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2020-04-02T23:50:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2020-04-02T23:50:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2020-04-02T23:50:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2020-04-02T23:50:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2020-04-02T23:50:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2020-04-02T23:50:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2020-04-02T23:50:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2020-04-02T23:50:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2020-04-02T23:50:16.242 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2020-04-02T23:50:16.242 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2020-04-02T23:50:16.242 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2020-04-02T23:50:16.242 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2020-04-02T23:50:16.242 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2020-04-02T23:50:16.242 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2020-04-02T23:50:16.242 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2020-04-02T23:50:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2020-04-02T23:50:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2020-04-02T23:50:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2020-04-02T23:50:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2020-04-02T23:50:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2020-04-02T23:50:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2020-04-02T23:50:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2020-04-02T23:50:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2020-04-02T23:50:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2020-04-02T23:50:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2020-04-02T23:50:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2020-04-02T23:50:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2020-04-02T23:50:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2020-04-02T23:50:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2020-04-02T23:50:16.245 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2020-04-02T23:50:16.245 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2020-04-02T23:50:16.245 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2020-04-02T23:50:16.245 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2020-04-02T23:50:16.245 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2020-04-02T23:50:16.246 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2020-04-02T23:50:16.246 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2020-04-02T23:50:16.246 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2020-04-02T23:50:16.246 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2020-04-02T23:50:16.246 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2020-04-02T23:50:16.247 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2020-04-02T23:50:16.247 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2020-04-02T23:50:16.247 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2020-04-02T23:50:16.247 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2020-04-02T23:50:16.247 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2020-04-02T23:50:16.247 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2020-04-02T23:50:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2020-04-02T23:50:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2020-04-02T23:50:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2020-04-02T23:50:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2020-04-02T23:50:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2020-04-02T23:50:19.136 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2020-04-02T23:50:19.136 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2020-04-02T23:50:19.136 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2020-04-02T23:50:19.137 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2020-04-02T23:50:19.138 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2020-04-02T23:50:19.138 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2020-04-02T23:50:19.138 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2020-04-02T23:50:19.138 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2020-04-02T23:50:19.138 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2020-04-02T23:50:19.139 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2020-04-02T23:50:19.140 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2020-04-02T23:50:19.140 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2020-04-02T23:50:19.140 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2020-04-02T23:50:19.140 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2020-04-02T23:50:19.140 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2020-04-02T23:50:19.140 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2020-04-02T23:50:19.140 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2020-04-02T23:50:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2020-04-02T23:50:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2020-04-02T23:50:19.143 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2020-04-02T23:50:19.144 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2020-04-02T23:50:19.144 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2020-04-02T23:50:19.144 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2020-04-02T23:50:19.144 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2020-04-02T23:50:19.144 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2020-04-02T23:50:19.144 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2020-04-02T23:50:19.144 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2020-04-02T23:50:19.145 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2020-04-02T23:50:19.145 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2020-04-02T23:50:19.145 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2020-04-02T23:50:19.145 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2020-04-02T23:50:19.145 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2020-04-02T23:50:19.146 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2020-04-02T23:50:19.151 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2020-04-02T23:50:19.151 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2020-04-02T23:50:19.151 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2020-04-02T23:50:19.152 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2020-04-02T23:50:19.152 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2020-04-02T23:50:19.152 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2020-04-02T23:50:21.542 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2020-04-02T23:50:21.542 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2020-04-02T23:50:21.542 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2020-04-02T23:50:21.542 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2020-04-02T23:50:21.543 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2020-04-02T23:50:21.543 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2020-04-02T23:50:21.543 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2020-04-02T23:50:21.543 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2020-04-02T23:50:21.543 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2020-04-02T23:50:21.543 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2020-04-02T23:50:21.543 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2020-04-02T23:50:21.544 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2020-04-02T23:50:21.545 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2020-04-02T23:50:21.545 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2020-04-02T23:50:21.545 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2020-04-02T23:50:21.545 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2020-04-02T23:50:21.545 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2020-04-02T23:50:21.545 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2020-04-02T23:50:21.545 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2020-04-02T23:50:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2020-04-02T23:50:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2020-04-02T23:50:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2020-04-02T23:50:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2020-04-02T23:50:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2020-04-02T23:50:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2020-04-02T23:50:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2020-04-02T23:50:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2020-04-02T23:50:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2020-04-02T23:50:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2020-04-02T23:50:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2020-04-02T23:50:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2020-04-02T23:50:21.552 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2020-04-02T23:50:23.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2020-04-02T23:50:23.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2020-04-02T23:50:23.927 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2020-04-02T23:50:23.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2020-04-02T23:50:23.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2020-04-02T23:50:23.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2020-04-02T23:50:23.928 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2020-04-02T23:50:23.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2020-04-02T23:50:23.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2020-04-02T23:50:23.929 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2020-04-02T23:50:23.937 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2020-04-02T23:50:23.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2020-04-02T23:50:23.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2020-04-02T23:50:23.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2020-04-02T23:50:23.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2020-04-02T23:50:23.938 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2020-04-02T23:50:23.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2020-04-02T23:50:23.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2020-04-02T23:50:23.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2020-04-02T23:50:23.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2020-04-02T23:50:23.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2020-04-02T23:50:23.939 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2020-04-02T23:50:23.940 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2020-04-02T23:50:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2020-04-02T23:50:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2020-04-02T23:50:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2020-04-02T23:50:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2020-04-02T23:50:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2020-04-02T23:50:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2020-04-02T23:50:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2020-04-02T23:50:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2020-04-02T23:50:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2020-04-02T23:50:23.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2020-04-02T23:50:23.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2020-04-02T23:50:23.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2020-04-02T23:50:23.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2020-04-02T23:50:23.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2020-04-02T23:50:23.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2020-04-02T23:50:23.944 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2020-04-02T23:50:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2020-04-02T23:50:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2020-04-02T23:50:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2020-04-02T23:50:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2020-04-02T23:50:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2020-04-02T23:50:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2020-04-02T23:50:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2020-04-02T23:50:23.946 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2020-04-02T23:50:23.946 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2020-04-02T23:50:23.946 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2020-04-02T23:50:23.946 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2020-04-02T23:50:23.946 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2020-04-02T23:50:23.946 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2020-04-02T23:50:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2020-04-02T23:50:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2020-04-02T23:50:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2020-04-02T23:50:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2020-04-02T23:50:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2020-04-02T23:50:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2020-04-02T23:50:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2020-04-02T23:50:23.948 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2020-04-02T23:50:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2020-04-02T23:50:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2020-04-02T23:50:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2020-04-02T23:50:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2020-04-02T23:50:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2020-04-02T23:50:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2020-04-02T23:50:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2020-04-02T23:50:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2020-04-02T23:50:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2020-04-02T23:50:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2020-04-02T23:50:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2020-04-02T23:50:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2020-04-02T23:50:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2020-04-02T23:50:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2020-04-02T23:50:25.766 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2020-04-02T23:50:25.766 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2020-04-02T23:50:25.766 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2020-04-02T23:50:25.766 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2020-04-02T23:50:25.766 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2020-04-02T23:50:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2020-04-02T23:50:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2020-04-02T23:50:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2020-04-02T23:50:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2020-04-02T23:50:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2020-04-02T23:50:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2020-04-02T23:50:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2020-04-02T23:50:25.775 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2020-04-02T23:50:25.775 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2020-04-02T23:50:25.775 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2020-04-02T23:50:25.775 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2020-04-02T23:50:25.775 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2020-04-02T23:50:25.775 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2020-04-02T23:50:25.775 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2020-04-02T23:50:25.783 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2020-04-02T23:50:25.783 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2020-04-02T23:50:25.784 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2020-04-02T23:50:25.784 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2020-04-02T23:50:25.784 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2020-04-02T23:50:25.784 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2020-04-02T23:50:25.784 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2020-04-02T23:50:25.784 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2020-04-02T23:50:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2020-04-02T23:50:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2020-04-02T23:50:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2020-04-02T23:50:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2020-04-02T23:50:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2020-04-02T23:50:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2020-04-02T23:50:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2020-04-02T23:50:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2020-04-02T23:50:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2020-04-02T23:50:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2020-04-02T23:50:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2020-04-02T23:50:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2020-04-02T23:50:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2020-04-02T23:50:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2020-04-02T23:50:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2020-04-02T23:50:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2020-04-02T23:50:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2020-04-02T23:50:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2020-04-02T23:50:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2020-04-02T23:50:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2020-04-02T23:50:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2020-04-02T23:50:25.789 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2020-04-02T23:50:25.789 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2020-04-02T23:50:25.789 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2020-04-02T23:50:25.789 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2020-04-02T23:50:25.789 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2020-04-02T23:50:25.973 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:50:25.988 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:26.031 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:50:26.045 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:30.855 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2020-04-02T23:50:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2020-04-02T23:50:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2020-04-02T23:50:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2020-04-02T23:50:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2020-04-02T23:50:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2020-04-02T23:50:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2020-04-02T23:50:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2020-04-02T23:50:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2020-04-02T23:50:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2020-04-02T23:50:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2020-04-02T23:50:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2020-04-02T23:50:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2020-04-02T23:50:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2020-04-02T23:50:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2020-04-02T23:50:30.858 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2020-04-02T23:50:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2020-04-02T23:50:30.860 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2020-04-02T23:50:30.860 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2020-04-02T23:50:30.860 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2020-04-02T23:50:30.860 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2020-04-02T23:50:30.860 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2020-04-02T23:50:30.860 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2020-04-02T23:50:30.860 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2020-04-02T23:50:30.861 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2020-04-02T23:50:30.861 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2020-04-02T23:50:30.861 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2020-04-02T23:50:30.861 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2020-04-02T23:50:30.862 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2020-04-02T23:50:30.862 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2020-04-02T23:50:30.862 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2020-04-02T23:50:30.862 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2020-04-02T23:50:30.862 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2020-04-02T23:50:30.863 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2020-04-02T23:50:30.863 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2020-04-02T23:50:30.863 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2020-04-02T23:50:30.863 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2020-04-02T23:50:30.863 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2020-04-02T23:50:30.863 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2020-04-02T23:50:30.864 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2020-04-02T23:50:30.864 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2020-04-02T23:50:30.864 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2020-04-02T23:50:30.864 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2020-04-02T23:50:30.864 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2020-04-02T23:50:30.864 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2020-04-02T23:50:30.864 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2020-04-02T23:50:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2020-04-02T23:50:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2020-04-02T23:50:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2020-04-02T23:50:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2020-04-02T23:50:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2020-04-02T23:50:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2020-04-02T23:50:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:Take third snapshot .snap/test3 2020-04-02T23:50:30.894 INFO:tasks.workunit.client.0.smithi082.stdout:Delete the snapshots... 2020-04-02T23:50:32.710 INFO:tasks.workunit.client.0.smithi082.stdout:.//.snap/test1 2020-04-02T23:50:32.711 INFO:tasks.workunit.client.0.smithi082.stdout:.//.snap/test2 2020-04-02T23:50:32.711 INFO:tasks.workunit.client.0.smithi082.stdout:.//.snap/test3 2020-04-02T23:50:32.718 INFO:tasks.workunit.client.0.smithi082.stdout:./274/.snap/snap-subdir-test 2020-04-02T23:50:32.727 INFO:tasks.workunit.client.0.smithi082.stdout:./166/.snap/snap-subdir-test 2020-04-02T23:50:32.736 INFO:tasks.workunit.client.0.smithi082.stdout:./256/.snap/snap-subdir-test 2020-04-02T23:50:32.744 INFO:tasks.workunit.client.0.smithi082.stdout:./247/.snap/snap-subdir-test 2020-04-02T23:50:32.752 INFO:tasks.workunit.client.0.smithi082.stdout:./248/.snap/snap-subdir-test 2020-04-02T23:50:32.761 INFO:tasks.workunit.client.0.smithi082.stdout:./147/.snap/snap-subdir-test 2020-04-02T23:50:32.769 INFO:tasks.workunit.client.0.smithi082.stdout:./151/.snap/snap-subdir-test 2020-04-02T23:50:32.778 INFO:tasks.workunit.client.0.smithi082.stdout:./170/.snap/snap-subdir-test 2020-04-02T23:50:32.787 INFO:tasks.workunit.client.0.smithi082.stdout:./167/.snap/snap-subdir-test 2020-04-02T23:50:32.795 INFO:tasks.workunit.client.0.smithi082.stdout:./140/.snap/snap-subdir-test 2020-04-02T23:50:32.925 INFO:tasks.workunit.client.0.smithi082.stdout:./142/.snap/snap-subdir-test 2020-04-02T23:50:32.933 INFO:tasks.workunit.client.0.smithi082.stdout:./150/.snap/snap-subdir-test 2020-04-02T23:50:32.942 INFO:tasks.workunit.client.0.smithi082.stdout:./273/.snap/snap-subdir-test 2020-04-02T23:50:32.950 INFO:tasks.workunit.client.0.smithi082.stdout:./269/.snap/snap-subdir-test 2020-04-02T23:50:32.960 INFO:tasks.workunit.client.0.smithi082.stdout:./105/.snap/snap-subdir-test 2020-04-02T23:50:32.967 INFO:tasks.workunit.client.0.smithi082.stdout:./210/.snap/snap-subdir-test 2020-04-02T23:50:32.975 INFO:tasks.workunit.client.0.smithi082.stdout:./265/.snap/snap-subdir-test 2020-04-02T23:50:32.990 INFO:tasks.workunit.client.0.smithi082.stdout:./218/.snap/snap-subdir-test 2020-04-02T23:50:32.998 INFO:tasks.workunit.client.0.smithi082.stdout:./290/.snap/snap-subdir-test 2020-04-02T23:50:33.007 INFO:tasks.workunit.client.0.smithi082.stdout:./149/.snap/snap-subdir-test 2020-04-02T23:50:33.015 INFO:tasks.workunit.client.0.smithi082.stdout:./109/.snap/snap-subdir-test 2020-04-02T23:50:33.023 INFO:tasks.workunit.client.0.smithi082.stdout:./292/.snap/snap-subdir-test 2020-04-02T23:50:33.031 INFO:tasks.workunit.client.0.smithi082.stdout:./242/.snap/snap-subdir-test 2020-04-02T23:50:33.040 INFO:tasks.workunit.client.0.smithi082.stdout:./158/.snap/snap-subdir-test 2020-04-02T23:50:33.049 INFO:tasks.workunit.client.0.smithi082.stdout:./243/.snap/snap-subdir-test 2020-04-02T23:50:33.058 INFO:tasks.workunit.client.0.smithi082.stdout:./106/.snap/snap-subdir-test 2020-04-02T23:50:33.066 INFO:tasks.workunit.client.0.smithi082.stdout:./250/.snap/snap-subdir-test 2020-04-02T23:50:33.074 INFO:tasks.workunit.client.0.smithi082.stdout:./221/.snap/snap-subdir-test 2020-04-02T23:50:33.082 INFO:tasks.workunit.client.0.smithi082.stdout:./244/.snap/snap-subdir-test 2020-04-02T23:50:33.293 INFO:tasks.workunit.client.0.smithi082.stdout:./258/.snap/snap-subdir-test 2020-04-02T23:50:33.301 INFO:tasks.workunit.client.0.smithi082.stdout:./268/.snap/snap-subdir-test 2020-04-02T23:50:33.309 INFO:tasks.workunit.client.0.smithi082.stdout:./189/.snap/snap-subdir-test 2020-04-02T23:50:33.317 INFO:tasks.workunit.client.0.smithi082.stdout:./285/.snap/snap-subdir-test 2020-04-02T23:50:33.325 INFO:tasks.workunit.client.0.smithi082.stdout:./208/.snap/snap-subdir-test 2020-04-02T23:50:33.334 INFO:tasks.workunit.client.0.smithi082.stdout:./288/.snap/snap-subdir-test 2020-04-02T23:50:33.342 INFO:tasks.workunit.client.0.smithi082.stdout:./209/.snap/snap-subdir-test 2020-04-02T23:50:33.354 INFO:tasks.workunit.client.0.smithi082.stdout:./253/.snap/snap-subdir-test 2020-04-02T23:50:33.360 INFO:tasks.workunit.client.0.smithi082.stdout:./249/.snap/snap-subdir-test 2020-04-02T23:50:33.366 INFO:tasks.workunit.client.0.smithi082.stdout:./133/.snap/snap-subdir-test 2020-04-02T23:50:33.375 INFO:tasks.workunit.client.0.smithi082.stdout:./291/.snap/snap-subdir-test 2020-04-02T23:50:33.383 INFO:tasks.workunit.client.0.smithi082.stdout:./226/.snap/snap-subdir-test 2020-04-02T23:50:33.392 INFO:tasks.workunit.client.0.smithi082.stdout:./173/.snap/snap-subdir-test 2020-04-02T23:50:33.401 INFO:tasks.workunit.client.0.smithi082.stdout:./174/.snap/snap-subdir-test 2020-04-02T23:50:33.409 INFO:tasks.workunit.client.0.smithi082.stdout:./299/.snap/snap-subdir-test 2020-04-02T23:50:33.417 INFO:tasks.workunit.client.0.smithi082.stdout:./262/.snap/snap-subdir-test 2020-04-02T23:50:33.427 INFO:tasks.workunit.client.0.smithi082.stdout:./231/.snap/snap-subdir-test 2020-04-02T23:50:33.437 INFO:tasks.workunit.client.0.smithi082.stdout:./214/.snap/snap-subdir-test 2020-04-02T23:50:33.449 INFO:tasks.workunit.client.0.smithi082.stdout:./281/.snap/snap-subdir-test 2020-04-02T23:50:33.452 INFO:tasks.workunit.client.0.smithi082.stdout:./289/.snap/snap-subdir-test 2020-04-02T23:50:33.458 INFO:tasks.workunit.client.0.smithi082.stdout:./283/.snap/snap-subdir-test 2020-04-02T23:50:33.711 INFO:tasks.workunit.client.0.smithi082.stdout:./232/.snap/snap-subdir-test 2020-04-02T23:50:33.725 INFO:tasks.workunit.client.0.smithi082.stdout:./298/.snap/snap-subdir-test 2020-04-02T23:50:33.889 INFO:tasks.workunit.client.0.smithi082.stdout:./233/.snap/snap-subdir-test 2020-04-02T23:50:33.898 INFO:tasks.workunit.client.0.smithi082.stdout:./155/.snap/snap-subdir-test 2020-04-02T23:50:33.908 INFO:tasks.workunit.client.0.smithi082.stdout:./114/.snap/snap-subdir-test 2020-04-02T23:50:33.918 INFO:tasks.workunit.client.0.smithi082.stdout:./159/.snap/snap-subdir-test 2020-04-02T23:50:33.927 INFO:tasks.workunit.client.0.smithi082.stdout:./187/.snap/snap-subdir-test 2020-04-02T23:50:33.936 INFO:tasks.workunit.client.0.smithi082.stdout:./185/.snap/snap-subdir-test 2020-04-02T23:50:33.947 INFO:tasks.workunit.client.0.smithi082.stdout:./293/.snap/snap-subdir-test 2020-04-02T23:50:34.130 INFO:tasks.workunit.client.0.smithi082.stdout:./228/.snap/snap-subdir-test 2020-04-02T23:50:34.141 INFO:tasks.workunit.client.0.smithi082.stdout:./120/.snap/snap-subdir-test 2020-04-02T23:50:34.153 INFO:tasks.workunit.client.0.smithi082.stdout:./110/.snap/snap-subdir-test 2020-04-02T23:50:34.164 INFO:tasks.workunit.client.0.smithi082.stdout:./267/.snap/snap-subdir-test 2020-04-02T23:50:34.172 INFO:tasks.workunit.client.0.smithi082.stdout:./202/.snap/snap-subdir-test 2020-04-02T23:50:34.181 INFO:tasks.workunit.client.0.smithi082.stdout:./137/.snap/snap-subdir-test 2020-04-02T23:50:34.190 INFO:tasks.workunit.client.0.smithi082.stdout:./246/.snap/snap-subdir-test 2020-04-02T23:50:34.198 INFO:tasks.workunit.client.0.smithi082.stdout:./219/.snap/snap-subdir-test 2020-04-02T23:50:34.211 INFO:tasks.workunit.client.0.smithi082.stdout:./198/.snap/snap-subdir-test 2020-04-02T23:50:34.216 INFO:tasks.workunit.client.0.smithi082.stdout:./136/.snap/snap-subdir-test 2020-04-02T23:50:34.224 INFO:tasks.workunit.client.0.smithi082.stdout:./270/.snap/snap-subdir-test 2020-04-02T23:50:34.233 INFO:tasks.workunit.client.0.smithi082.stdout:./125/.snap/snap-subdir-test 2020-04-02T23:50:34.241 INFO:tasks.workunit.client.0.smithi082.stdout:./194/.snap/snap-subdir-test 2020-04-02T23:50:34.250 INFO:tasks.workunit.client.0.smithi082.stdout:./119/.snap/snap-subdir-test 2020-04-02T23:50:34.259 INFO:tasks.workunit.client.0.smithi082.stdout:./297/.snap/snap-subdir-test 2020-04-02T23:50:34.268 INFO:tasks.workunit.client.0.smithi082.stdout:./230/.snap/snap-subdir-test 2020-04-02T23:50:34.276 INFO:tasks.workunit.client.0.smithi082.stdout:./260/.snap/snap-subdir-test 2020-04-02T23:50:34.287 INFO:tasks.workunit.client.0.smithi082.stdout:./157/.snap/snap-subdir-test 2020-04-02T23:50:34.296 INFO:tasks.workunit.client.0.smithi082.stdout:./172/.snap/snap-subdir-test 2020-04-02T23:50:34.506 INFO:tasks.workunit.client.0.smithi082.stdout:./277/.snap/snap-subdir-test 2020-04-02T23:50:34.516 INFO:tasks.workunit.client.0.smithi082.stdout:./186/.snap/snap-subdir-test 2020-04-02T23:50:34.524 INFO:tasks.workunit.client.0.smithi082.stdout:./237/.snap/snap-subdir-test 2020-04-02T23:50:34.533 INFO:tasks.workunit.client.0.smithi082.stdout:./190/.snap/snap-subdir-test 2020-04-02T23:50:34.541 INFO:tasks.workunit.client.0.smithi082.stdout:./213/.snap/snap-subdir-test 2020-04-02T23:50:34.550 INFO:tasks.workunit.client.0.smithi082.stdout:./104/.snap/snap-subdir-test 2020-04-02T23:50:34.558 INFO:tasks.workunit.client.0.smithi082.stdout:./164/.snap/snap-subdir-test 2020-04-02T23:50:34.567 INFO:tasks.workunit.client.0.smithi082.stdout:./112/.snap/snap-subdir-test 2020-04-02T23:50:34.576 INFO:tasks.workunit.client.0.smithi082.stdout:./295/.snap/snap-subdir-test 2020-04-02T23:50:34.586 INFO:tasks.workunit.client.0.smithi082.stdout:./272/.snap/snap-subdir-test 2020-04-02T23:50:34.593 INFO:tasks.workunit.client.0.smithi082.stdout:./100/.snap/snap-subdir-test 2020-04-02T23:50:34.602 INFO:tasks.workunit.client.0.smithi082.stdout:./134/.snap/snap-subdir-test 2020-04-02T23:50:34.610 INFO:tasks.workunit.client.0.smithi082.stdout:./200/.snap/snap-subdir-test 2020-04-02T23:50:34.629 INFO:tasks.workunit.client.0.smithi082.stdout:./115/.snap/snap-subdir-test 2020-04-02T23:50:34.629 INFO:tasks.workunit.client.0.smithi082.stdout:./284/.snap/snap-subdir-test 2020-04-02T23:50:34.637 INFO:tasks.workunit.client.0.smithi082.stdout:./280/.snap/snap-subdir-test 2020-04-02T23:50:34.644 INFO:tasks.workunit.client.0.smithi082.stdout:./116/.snap/snap-subdir-test 2020-04-02T23:50:34.653 INFO:tasks.workunit.client.0.smithi082.stdout:./245/.snap/snap-subdir-test 2020-04-02T23:50:34.662 INFO:tasks.workunit.client.0.smithi082.stdout:./195/.snap/snap-subdir-test 2020-04-02T23:50:34.670 INFO:tasks.workunit.client.0.smithi082.stdout:./138/.snap/snap-subdir-test 2020-04-02T23:50:34.681 INFO:tasks.workunit.client.0.smithi082.stdout:./135/.snap/snap-subdir-test 2020-04-02T23:50:34.689 INFO:tasks.workunit.client.0.smithi082.stdout:./117/.snap/snap-subdir-test 2020-04-02T23:50:34.697 INFO:tasks.workunit.client.0.smithi082.stdout:./241/.snap/snap-subdir-test 2020-04-02T23:50:34.706 INFO:tasks.workunit.client.0.smithi082.stdout:./143/.snap/snap-subdir-test 2020-04-02T23:50:34.714 INFO:tasks.workunit.client.0.smithi082.stdout:./180/.snap/snap-subdir-test 2020-04-02T23:50:35.647 INFO:tasks.workunit.client.0.smithi082.stdout:./126/.snap/snap-subdir-test 2020-04-02T23:50:35.657 INFO:tasks.workunit.client.0.smithi082.stdout:./161/.snap/snap-subdir-test 2020-04-02T23:50:35.667 INFO:tasks.workunit.client.0.smithi082.stdout:./204/.snap/snap-subdir-test 2020-04-02T23:50:35.676 INFO:tasks.workunit.client.0.smithi082.stdout:./176/.snap/snap-subdir-test 2020-04-02T23:50:35.685 INFO:tasks.workunit.client.0.smithi082.stdout:./255/.snap/snap-subdir-test 2020-04-02T23:50:35.694 INFO:tasks.workunit.client.0.smithi082.stdout:./215/.snap/snap-subdir-test 2020-04-02T23:50:35.703 INFO:tasks.workunit.client.0.smithi082.stdout:./111/.snap/snap-subdir-test 2020-04-02T23:50:35.712 INFO:tasks.workunit.client.0.smithi082.stdout:./238/.snap/snap-subdir-test 2020-04-02T23:50:35.723 INFO:tasks.workunit.client.0.smithi082.stdout:./191/.snap/snap-subdir-test 2020-04-02T23:50:35.731 INFO:tasks.workunit.client.0.smithi082.stdout:./184/.snap/snap-subdir-test 2020-04-02T23:50:35.740 INFO:tasks.workunit.client.0.smithi082.stdout:./192/.snap/snap-subdir-test 2020-04-02T23:50:35.749 INFO:tasks.workunit.client.0.smithi082.stdout:./103/.snap/snap-subdir-test 2020-04-02T23:50:35.759 INFO:tasks.workunit.client.0.smithi082.stdout:./128/.snap/snap-subdir-test 2020-04-02T23:50:35.769 INFO:tasks.workunit.client.0.smithi082.stdout:./229/.snap/snap-subdir-test 2020-04-02T23:50:35.781 INFO:tasks.workunit.client.0.smithi082.stdout:./144/.snap/snap-subdir-test 2020-04-02T23:50:35.792 INFO:tasks.workunit.client.0.smithi082.stdout:./146/.snap/snap-subdir-test 2020-04-02T23:50:35.801 INFO:tasks.workunit.client.0.smithi082.stdout:./227/.snap/snap-subdir-test 2020-04-02T23:50:35.810 INFO:tasks.workunit.client.0.smithi082.stdout:./278/.snap/snap-subdir-test 2020-04-02T23:50:35.821 INFO:tasks.workunit.client.0.smithi082.stdout:./141/.snap/snap-subdir-test 2020-04-02T23:50:35.827 INFO:tasks.workunit.client.0.smithi082.stdout:./234/.snap/snap-subdir-test 2020-04-02T23:50:35.836 INFO:tasks.workunit.client.0.smithi082.stdout:./225/.snap/snap-subdir-test 2020-04-02T23:50:35.845 INFO:tasks.workunit.client.0.smithi082.stdout:./182/.snap/snap-subdir-test 2020-04-02T23:50:35.854 INFO:tasks.workunit.client.0.smithi082.stdout:./107/.snap/snap-subdir-test 2020-04-02T23:50:35.862 INFO:tasks.workunit.client.0.smithi082.stdout:./178/.snap/snap-subdir-test 2020-04-02T23:50:35.870 INFO:tasks.workunit.client.0.smithi082.stdout:./266/.snap/snap-subdir-test 2020-04-02T23:50:35.878 INFO:tasks.workunit.client.0.smithi082.stdout:./240/.snap/snap-subdir-test 2020-04-02T23:50:35.887 INFO:tasks.workunit.client.0.smithi082.stdout:./156/.snap/snap-subdir-test 2020-04-02T23:50:35.900 INFO:tasks.workunit.client.0.smithi082.stdout:./131/.snap/snap-subdir-test 2020-04-02T23:50:35.905 INFO:tasks.workunit.client.0.smithi082.stdout:./123/.snap/snap-subdir-test 2020-04-02T23:50:35.914 INFO:tasks.workunit.client.0.smithi082.stdout:./160/.snap/snap-subdir-test 2020-04-02T23:50:35.923 INFO:tasks.workunit.client.0.smithi082.stdout:./165/.snap/snap-subdir-test 2020-04-02T23:50:35.931 INFO:tasks.workunit.client.0.smithi082.stdout:./101/.snap/snap-subdir-test 2020-04-02T23:50:36.567 INFO:tasks.workunit.client.0.smithi082.stdout:./148/.snap/snap-subdir-test 2020-04-02T23:50:36.652 INFO:tasks.workunit.client.0.smithi082.stdout:./168/.snap/snap-subdir-test 2020-04-02T23:50:36.662 INFO:tasks.workunit.client.0.smithi082.stdout:./179/.snap/snap-subdir-test 2020-04-02T23:50:36.671 INFO:tasks.workunit.client.0.smithi082.stdout:./257/.snap/snap-subdir-test 2020-04-02T23:50:36.679 INFO:tasks.workunit.client.0.smithi082.stdout:./252/.snap/snap-subdir-test 2020-04-02T23:50:36.688 INFO:tasks.workunit.client.0.smithi082.stdout:./132/.snap/snap-subdir-test 2020-04-02T23:50:36.697 INFO:tasks.workunit.client.0.smithi082.stdout:./236/.snap/snap-subdir-test 2020-04-02T23:50:36.706 INFO:tasks.workunit.client.0.smithi082.stdout:./211/.snap/snap-subdir-test 2020-04-02T23:50:36.715 INFO:tasks.workunit.client.0.smithi082.stdout:./199/.snap/snap-subdir-test 2020-04-02T23:50:36.723 INFO:tasks.workunit.client.0.smithi082.stdout:./205/.snap/snap-subdir-test 2020-04-02T23:50:36.736 INFO:tasks.workunit.client.0.smithi082.stdout:./163/.snap/snap-subdir-test 2020-04-02T23:50:36.740 INFO:tasks.workunit.client.0.smithi082.stdout:./261/.snap/snap-subdir-test 2020-04-02T23:50:37.689 INFO:tasks.workunit.client.0.smithi082.stdout:./201/.snap/snap-subdir-test 2020-04-02T23:50:37.700 INFO:tasks.workunit.client.0.smithi082.stdout:./282/.snap/snap-subdir-test 2020-04-02T23:50:37.711 INFO:tasks.workunit.client.0.smithi082.stdout:./296/.snap/snap-subdir-test 2020-04-02T23:50:37.720 INFO:tasks.workunit.client.0.smithi082.stdout:./217/.snap/snap-subdir-test 2020-04-02T23:50:37.730 INFO:tasks.workunit.client.0.smithi082.stdout:./153/.snap/snap-subdir-test 2020-04-02T23:50:37.740 INFO:tasks.workunit.client.0.smithi082.stdout:./206/.snap/snap-subdir-test 2020-04-02T23:50:37.749 INFO:tasks.workunit.client.0.smithi082.stdout:./122/.snap/snap-subdir-test 2020-04-02T23:50:37.759 INFO:tasks.workunit.client.0.smithi082.stdout:./162/.snap/snap-subdir-test 2020-04-02T23:50:37.768 INFO:tasks.workunit.client.0.smithi082.stdout:./197/.snap/snap-subdir-test 2020-04-02T23:50:37.777 INFO:tasks.workunit.client.0.smithi082.stdout:./216/.snap/snap-subdir-test 2020-04-02T23:50:39.395 INFO:tasks.workunit.client.0.smithi082.stdout:./254/.snap/snap-subdir-test 2020-04-02T23:50:39.411 INFO:tasks.workunit.client.0.smithi082.stdout:./113/.snap/snap-subdir-test 2020-04-02T23:50:39.415 INFO:tasks.workunit.client.0.smithi082.stdout:./152/.snap/snap-subdir-test 2020-04-02T23:50:39.423 INFO:tasks.workunit.client.0.smithi082.stdout:./121/.snap/snap-subdir-test 2020-04-02T23:50:39.432 INFO:tasks.workunit.client.0.smithi082.stdout:./118/.snap/snap-subdir-test 2020-04-02T23:50:39.441 INFO:tasks.workunit.client.0.smithi082.stdout:./196/.snap/snap-subdir-test 2020-04-02T23:50:39.452 INFO:tasks.workunit.client.0.smithi082.stdout:./124/.snap/snap-subdir-test 2020-04-02T23:50:39.461 INFO:tasks.workunit.client.0.smithi082.stdout:./239/.snap/snap-subdir-test 2020-04-02T23:50:39.468 INFO:tasks.workunit.client.0.smithi082.stdout:./188/.snap/snap-subdir-test 2020-04-02T23:50:39.477 INFO:tasks.workunit.client.0.smithi082.stdout:./287/.snap/snap-subdir-test 2020-04-02T23:50:39.485 INFO:tasks.workunit.client.0.smithi082.stdout:./275/.snap/snap-subdir-test 2020-04-02T23:50:39.493 INFO:tasks.workunit.client.0.smithi082.stdout:./259/.snap/snap-subdir-test 2020-04-02T23:50:39.902 INFO:tasks.workunit.client.0.smithi082.stdout:./224/.snap/snap-subdir-test 2020-04-02T23:50:39.913 INFO:tasks.workunit.client.0.smithi082.stdout:./264/.snap/snap-subdir-test 2020-04-02T23:50:39.925 INFO:tasks.workunit.client.0.smithi082.stdout:./145/.snap/snap-subdir-test 2020-04-02T23:50:39.933 INFO:tasks.workunit.client.0.smithi082.stdout:./279/.snap/snap-subdir-test 2020-04-02T23:50:39.937 INFO:tasks.workunit.client.0.smithi082.stdout:./263/.snap/snap-subdir-test 2020-04-02T23:50:39.945 INFO:tasks.workunit.client.0.smithi082.stdout:./130/.snap/snap-subdir-test 2020-04-02T23:50:39.954 INFO:tasks.workunit.client.0.smithi082.stdout:./193/.snap/snap-subdir-test 2020-04-02T23:50:39.962 INFO:tasks.workunit.client.0.smithi082.stdout:./223/.snap/snap-subdir-test 2020-04-02T23:50:39.970 INFO:tasks.workunit.client.0.smithi082.stdout:./207/.snap/snap-subdir-test 2020-04-02T23:50:39.978 INFO:tasks.workunit.client.0.smithi082.stdout:./276/.snap/snap-subdir-test 2020-04-02T23:50:39.986 INFO:tasks.workunit.client.0.smithi082.stdout:./271/.snap/snap-subdir-test 2020-04-02T23:50:39.994 INFO:tasks.workunit.client.0.smithi082.stdout:./251/.snap/snap-subdir-test 2020-04-02T23:50:40.003 INFO:tasks.workunit.client.0.smithi082.stdout:./175/.snap/snap-subdir-test 2020-04-02T23:50:40.012 INFO:tasks.workunit.client.0.smithi082.stdout:./222/.snap/snap-subdir-test 2020-04-02T23:50:40.020 INFO:tasks.workunit.client.0.smithi082.stdout:./220/.snap/snap-subdir-test 2020-04-02T23:50:40.930 INFO:tasks.workunit.client.0.smithi082.stdout:./203/.snap/snap-subdir-test 2020-04-02T23:50:40.942 INFO:tasks.workunit.client.0.smithi082.stdout:./181/.snap/snap-subdir-test 2020-04-02T23:50:40.952 INFO:tasks.workunit.client.0.smithi082.stdout:./286/.snap/snap-subdir-test 2020-04-02T23:50:40.963 INFO:tasks.workunit.client.0.smithi082.stdout:./127/.snap/snap-subdir-test 2020-04-02T23:50:41.837 INFO:tasks.workunit.client.0.smithi082.stdout:./108/.snap/snap-subdir-test 2020-04-02T23:50:42.153 INFO:tasks.workunit.client.0.smithi082.stdout:./183/.snap/snap-subdir-test 2020-04-02T23:50:42.164 INFO:tasks.workunit.client.0.smithi082.stdout:./294/.snap/snap-subdir-test 2020-04-02T23:50:42.174 INFO:tasks.workunit.client.0.smithi082.stdout:./235/.snap/snap-subdir-test 2020-04-02T23:50:42.185 INFO:tasks.workunit.client.0.smithi082.stdout:./177/.snap/snap-subdir-test 2020-04-02T23:50:42.196 INFO:tasks.workunit.client.0.smithi082.stdout:./169/.snap/snap-subdir-test 2020-04-02T23:50:42.206 INFO:tasks.workunit.client.0.smithi082.stdout:./212/.snap/snap-subdir-test 2020-04-02T23:50:42.216 INFO:tasks.workunit.client.0.smithi082.stdout:./154/.snap/snap-subdir-test 2020-04-02T23:50:42.226 INFO:tasks.workunit.client.0.smithi082.stdout:./171/.snap/snap-subdir-test 2020-04-02T23:50:42.236 INFO:tasks.workunit.client.0.smithi082.stdout:./139/.snap/snap-subdir-test 2020-04-02T23:50:42.246 INFO:tasks.workunit.client.0.smithi082.stdout:./102/.snap/snap-subdir-test 2020-04-02T23:50:42.256 INFO:tasks.workunit.client.0.smithi082.stdout:./129/.snap/snap-subdir-test 2020-04-02T23:50:51.680 INFO:tasks.workunit.client.0.smithi082.stdout:Delete all the files and directories ... 2020-04-02T23:50:56.143 INFO:teuthology.orchestra.run.smithi050:> true 2020-04-02T23:50:56.162 INFO:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:56.205 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:50:56.222 INFO:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:56.530 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/19' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/15' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/31' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/36' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/20' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/12' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/39' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/10' 2020-04-02T23:50:56.531 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/34' 2020-04-02T23:50:56.532 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/38' 2020-04-02T23:50:56.532 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/11' 2020-04-02T23:50:56.532 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/16' 2020-04-02T23:50:56.532 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/32' 2020-04-02T23:50:56.532 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/30' 2020-04-02T23:50:56.532 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/14' 2020-04-02T23:50:56.532 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/18' 2020-04-02T23:50:56.533 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/13' 2020-04-02T23:50:56.533 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/33' 2020-04-02T23:50:56.533 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/17' 2020-04-02T23:50:56.533 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/35' 2020-04-02T23:50:56.533 INFO:tasks.workunit.client.0.smithi082.stdout:removed './100/37' 2020-04-02T23:50:56.533 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './100' 2020-04-02T23:50:56.534 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/19' 2020-04-02T23:50:56.534 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/15' 2020-04-02T23:50:56.534 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/31' 2020-04-02T23:50:56.534 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/36' 2020-04-02T23:50:56.534 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/20' 2020-04-02T23:50:56.534 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/12' 2020-04-02T23:50:56.534 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/39' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/10' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/34' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/38' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/11' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/16' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/32' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/30' 2020-04-02T23:50:56.535 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/14' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/18' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/13' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/33' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/17' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/35' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed './101/37' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './101' 2020-04-02T23:50:56.536 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/19' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/15' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/31' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/36' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/20' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/12' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/39' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/10' 2020-04-02T23:50:56.537 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/34' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/38' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/11' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/16' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/32' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/30' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/14' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/18' 2020-04-02T23:50:56.538 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/13' 2020-04-02T23:50:56.539 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/33' 2020-04-02T23:50:56.539 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/17' 2020-04-02T23:50:56.539 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/35' 2020-04-02T23:50:56.539 INFO:tasks.workunit.client.0.smithi082.stdout:removed './102/37' 2020-04-02T23:50:56.544 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './102' 2020-04-02T23:50:56.544 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/19' 2020-04-02T23:50:56.544 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/15' 2020-04-02T23:50:56.544 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/31' 2020-04-02T23:50:56.545 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/36' 2020-04-02T23:50:56.545 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/20' 2020-04-02T23:50:56.545 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/12' 2020-04-02T23:50:56.545 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/39' 2020-04-02T23:50:56.545 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/10' 2020-04-02T23:50:56.545 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/34' 2020-04-02T23:50:56.545 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/38' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/11' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/16' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/32' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/30' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/14' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/18' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/13' 2020-04-02T23:50:56.546 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/33' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/17' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/35' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed './103/37' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './103' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/19' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/15' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/31' 2020-04-02T23:50:56.547 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/36' 2020-04-02T23:50:56.548 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/20' 2020-04-02T23:50:56.548 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/12' 2020-04-02T23:50:56.548 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/39' 2020-04-02T23:50:56.548 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/10' 2020-04-02T23:50:56.548 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/34' 2020-04-02T23:50:56.548 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/38' 2020-04-02T23:50:56.548 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/11' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/16' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/32' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/30' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/14' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/18' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/13' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/33' 2020-04-02T23:50:56.549 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/17' 2020-04-02T23:50:56.550 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/35' 2020-04-02T23:50:56.550 INFO:tasks.workunit.client.0.smithi082.stdout:removed './104/37' 2020-04-02T23:50:56.550 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './104' 2020-04-02T23:50:56.550 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/19' 2020-04-02T23:50:56.550 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/15' 2020-04-02T23:50:56.550 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/31' 2020-04-02T23:50:56.550 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/36' 2020-04-02T23:50:56.551 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/20' 2020-04-02T23:50:56.551 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/12' 2020-04-02T23:50:56.551 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/39' 2020-04-02T23:50:56.551 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/10' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/34' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/38' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/11' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/16' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/32' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/30' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/14' 2020-04-02T23:50:56.552 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/18' 2020-04-02T23:50:56.553 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/13' 2020-04-02T23:50:56.553 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/33' 2020-04-02T23:50:56.553 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/17' 2020-04-02T23:50:56.553 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/35' 2020-04-02T23:50:56.553 INFO:tasks.workunit.client.0.smithi082.stdout:removed './105/37' 2020-04-02T23:50:56.553 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './105' 2020-04-02T23:50:56.553 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/19' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/15' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/31' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/36' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/20' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/12' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/39' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/10' 2020-04-02T23:50:56.554 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/34' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/38' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/11' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/16' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/32' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/30' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/14' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/18' 2020-04-02T23:50:56.555 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/13' 2020-04-02T23:50:56.556 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/33' 2020-04-02T23:50:56.556 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/17' 2020-04-02T23:50:56.556 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/35' 2020-04-02T23:50:56.556 INFO:tasks.workunit.client.0.smithi082.stdout:removed './106/37' 2020-04-02T23:50:56.556 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './106' 2020-04-02T23:50:56.556 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/19' 2020-04-02T23:50:56.556 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/15' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/31' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/36' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/20' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/12' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/39' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/10' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/34' 2020-04-02T23:50:56.557 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/38' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/11' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/16' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/32' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/30' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/14' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/18' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/13' 2020-04-02T23:50:56.558 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/33' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/17' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/35' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed './107/37' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './107' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/19' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/15' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/31' 2020-04-02T23:50:56.559 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/36' 2020-04-02T23:50:56.560 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/20' 2020-04-02T23:50:56.560 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/12' 2020-04-02T23:50:56.560 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/39' 2020-04-02T23:50:56.560 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/10' 2020-04-02T23:50:56.560 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/34' 2020-04-02T23:50:56.560 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/38' 2020-04-02T23:50:56.560 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/11' 2020-04-02T23:50:56.561 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/16' 2020-04-02T23:50:56.561 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/32' 2020-04-02T23:50:56.561 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/30' 2020-04-02T23:50:56.561 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/14' 2020-04-02T23:50:56.561 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/18' 2020-04-02T23:50:56.561 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/13' 2020-04-02T23:50:56.561 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/33' 2020-04-02T23:50:56.562 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/17' 2020-04-02T23:50:56.562 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/35' 2020-04-02T23:50:56.562 INFO:tasks.workunit.client.0.smithi082.stdout:removed './108/37' 2020-04-02T23:50:56.562 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './108' 2020-04-02T23:50:56.562 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/19' 2020-04-02T23:50:56.562 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/15' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/31' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/36' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/20' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/12' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/39' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/10' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/34' 2020-04-02T23:50:56.563 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/38' 2020-04-02T23:50:56.564 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/11' 2020-04-02T23:50:56.564 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/16' 2020-04-02T23:50:56.564 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/32' 2020-04-02T23:50:56.564 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/30' 2020-04-02T23:50:57.645 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/14' 2020-04-02T23:50:57.646 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/18' 2020-04-02T23:50:57.646 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/13' 2020-04-02T23:50:57.646 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/33' 2020-04-02T23:50:57.646 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/17' 2020-04-02T23:50:57.646 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/35' 2020-04-02T23:50:57.646 INFO:tasks.workunit.client.0.smithi082.stdout:removed './109/37' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './109' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/19' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/15' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/31' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/36' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/20' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/12' 2020-04-02T23:50:57.647 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/39' 2020-04-02T23:50:57.648 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/10' 2020-04-02T23:50:57.648 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/34' 2020-04-02T23:50:57.648 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/38' 2020-04-02T23:50:57.648 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/11' 2020-04-02T23:50:57.648 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/16' 2020-04-02T23:50:57.648 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/32' 2020-04-02T23:50:57.648 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/30' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/14' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/18' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/13' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/33' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/17' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/35' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed './110/37' 2020-04-02T23:50:57.649 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './110' 2020-04-02T23:50:57.650 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/19' 2020-04-02T23:50:57.650 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/15' 2020-04-02T23:50:57.650 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/31' 2020-04-02T23:50:57.650 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/36' 2020-04-02T23:50:57.650 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/20' 2020-04-02T23:50:57.650 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/12' 2020-04-02T23:50:57.650 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/39' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/10' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/34' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/38' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/11' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/16' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/32' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/30' 2020-04-02T23:50:57.651 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/14' 2020-04-02T23:50:57.652 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/18' 2020-04-02T23:50:57.652 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/13' 2020-04-02T23:50:57.652 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/33' 2020-04-02T23:50:57.652 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/17' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/35' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed './111/37' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './111' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/19' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/15' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/31' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/36' 2020-04-02T23:50:57.653 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/20' 2020-04-02T23:50:57.654 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/12' 2020-04-02T23:50:57.654 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/39' 2020-04-02T23:50:57.654 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/10' 2020-04-02T23:50:57.655 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/34' 2020-04-02T23:50:57.655 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/38' 2020-04-02T23:50:57.656 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/11' 2020-04-02T23:50:57.656 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/16' 2020-04-02T23:50:57.656 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/32' 2020-04-02T23:50:57.656 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/30' 2020-04-02T23:50:57.656 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/14' 2020-04-02T23:50:57.656 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/18' 2020-04-02T23:50:57.656 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/13' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/33' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/17' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/35' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed './112/37' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './112' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/19' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/15' 2020-04-02T23:50:57.657 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/31' 2020-04-02T23:50:57.658 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/36' 2020-04-02T23:50:57.658 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/20' 2020-04-02T23:50:57.658 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/12' 2020-04-02T23:50:57.658 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/39' 2020-04-02T23:50:57.658 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/10' 2020-04-02T23:50:57.658 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/34' 2020-04-02T23:50:57.658 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/38' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/11' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/16' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/32' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/30' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/14' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/18' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/13' 2020-04-02T23:50:57.659 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/33' 2020-04-02T23:50:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/17' 2020-04-02T23:50:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/35' 2020-04-02T23:50:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:removed './113/37' 2020-04-02T23:50:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './113' 2020-04-02T23:50:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/19' 2020-04-02T23:50:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/15' 2020-04-02T23:50:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/31' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/36' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/20' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/12' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/39' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/10' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/34' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/38' 2020-04-02T23:50:57.661 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/11' 2020-04-02T23:50:57.662 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/16' 2020-04-02T23:50:57.662 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/32' 2020-04-02T23:50:57.662 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/30' 2020-04-02T23:50:57.662 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/14' 2020-04-02T23:50:57.662 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/18' 2020-04-02T23:50:57.662 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/13' 2020-04-02T23:50:57.663 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/33' 2020-04-02T23:50:57.663 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/17' 2020-04-02T23:50:57.663 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/35' 2020-04-02T23:50:57.663 INFO:tasks.workunit.client.0.smithi082.stdout:removed './114/37' 2020-04-02T23:50:57.663 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './114' 2020-04-02T23:50:57.663 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/19' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/15' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/31' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/36' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/20' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/12' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/39' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/10' 2020-04-02T23:50:57.664 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/34' 2020-04-02T23:50:57.665 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/38' 2020-04-02T23:50:57.665 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/11' 2020-04-02T23:50:57.665 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/16' 2020-04-02T23:50:57.665 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/32' 2020-04-02T23:50:57.665 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/30' 2020-04-02T23:50:57.665 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/14' 2020-04-02T23:50:57.665 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/18' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/13' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/33' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/17' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/35' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed './115/37' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './115' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/19' 2020-04-02T23:50:57.666 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/15' 2020-04-02T23:50:57.667 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/31' 2020-04-02T23:50:57.667 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/36' 2020-04-02T23:50:57.667 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/20' 2020-04-02T23:50:57.667 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/12' 2020-04-02T23:50:57.667 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/39' 2020-04-02T23:50:57.667 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/10' 2020-04-02T23:50:57.667 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/34' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/38' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/11' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/16' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/32' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/30' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/14' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/18' 2020-04-02T23:50:57.668 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/13' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/33' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/17' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/35' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed './116/37' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './116' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/19' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/15' 2020-04-02T23:50:57.669 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/31' 2020-04-02T23:50:57.670 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/36' 2020-04-02T23:50:57.670 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/20' 2020-04-02T23:50:57.670 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/12' 2020-04-02T23:50:57.670 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/39' 2020-04-02T23:50:57.670 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/10' 2020-04-02T23:50:57.670 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/34' 2020-04-02T23:50:57.670 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/38' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/11' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/16' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/32' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/30' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/14' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/18' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/13' 2020-04-02T23:50:57.671 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/33' 2020-04-02T23:50:57.672 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/17' 2020-04-02T23:50:57.672 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/35' 2020-04-02T23:50:57.672 INFO:tasks.workunit.client.0.smithi082.stdout:removed './117/37' 2020-04-02T23:50:57.672 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './117' 2020-04-02T23:50:57.672 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/19' 2020-04-02T23:50:57.672 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/15' 2020-04-02T23:50:57.672 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/31' 2020-04-02T23:50:57.673 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/36' 2020-04-02T23:50:57.673 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/20' 2020-04-02T23:50:57.673 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/12' 2020-04-02T23:50:57.673 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/39' 2020-04-02T23:50:57.673 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/10' 2020-04-02T23:50:57.674 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/34' 2020-04-02T23:50:57.674 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/38' 2020-04-02T23:50:57.674 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/11' 2020-04-02T23:50:57.674 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/16' 2020-04-02T23:50:57.674 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/32' 2020-04-02T23:50:57.674 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/30' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/14' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/18' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/13' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/33' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/17' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/35' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed './118/37' 2020-04-02T23:50:57.675 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './118' 2020-04-02T23:50:57.676 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/19' 2020-04-02T23:50:57.676 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/15' 2020-04-02T23:50:57.676 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/31' 2020-04-02T23:50:57.676 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/36' 2020-04-02T23:50:57.676 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/20' 2020-04-02T23:50:57.676 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/12' 2020-04-02T23:50:59.731 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/39' 2020-04-02T23:50:59.732 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/10' 2020-04-02T23:50:59.732 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/34' 2020-04-02T23:50:59.732 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/38' 2020-04-02T23:50:59.732 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/11' 2020-04-02T23:50:59.732 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/16' 2020-04-02T23:50:59.732 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/32' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/30' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/14' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/18' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/13' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/33' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/17' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/35' 2020-04-02T23:50:59.733 INFO:tasks.workunit.client.0.smithi082.stdout:removed './119/37' 2020-04-02T23:50:59.734 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './119' 2020-04-02T23:50:59.734 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/19' 2020-04-02T23:50:59.734 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/15' 2020-04-02T23:50:59.734 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/31' 2020-04-02T23:50:59.734 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/36' 2020-04-02T23:50:59.734 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/20' 2020-04-02T23:50:59.734 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/12' 2020-04-02T23:50:59.735 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/39' 2020-04-02T23:50:59.735 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/10' 2020-04-02T23:50:59.735 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/34' 2020-04-02T23:50:59.735 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/38' 2020-04-02T23:50:59.735 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/11' 2020-04-02T23:50:59.735 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/16' 2020-04-02T23:50:59.738 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/32' 2020-04-02T23:50:59.739 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/30' 2020-04-02T23:50:59.739 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/14' 2020-04-02T23:50:59.739 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/18' 2020-04-02T23:50:59.739 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/13' 2020-04-02T23:50:59.739 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/33' 2020-04-02T23:50:59.739 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/17' 2020-04-02T23:50:59.740 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/35' 2020-04-02T23:50:59.740 INFO:tasks.workunit.client.0.smithi082.stdout:removed './120/37' 2020-04-02T23:50:59.740 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './120' 2020-04-02T23:50:59.740 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/19' 2020-04-02T23:50:59.740 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/15' 2020-04-02T23:50:59.741 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/31' 2020-04-02T23:50:59.741 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/36' 2020-04-02T23:50:59.741 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/20' 2020-04-02T23:50:59.741 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/12' 2020-04-02T23:50:59.741 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/39' 2020-04-02T23:50:59.741 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/10' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/34' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/38' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/11' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/16' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/32' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/30' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/14' 2020-04-02T23:50:59.742 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/18' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/13' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/33' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/17' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/35' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed './121/37' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './121' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/19' 2020-04-02T23:50:59.743 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/15' 2020-04-02T23:50:59.744 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/31' 2020-04-02T23:50:59.744 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/36' 2020-04-02T23:50:59.744 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/20' 2020-04-02T23:50:59.744 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/12' 2020-04-02T23:50:59.744 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/39' 2020-04-02T23:50:59.744 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/10' 2020-04-02T23:50:59.744 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/34' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/38' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/11' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/16' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/32' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/30' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/14' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/18' 2020-04-02T23:50:59.745 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/13' 2020-04-02T23:50:59.746 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/33' 2020-04-02T23:50:59.746 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/17' 2020-04-02T23:50:59.746 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/35' 2020-04-02T23:50:59.746 INFO:tasks.workunit.client.0.smithi082.stdout:removed './122/37' 2020-04-02T23:50:59.746 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './122' 2020-04-02T23:50:59.746 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/19' 2020-04-02T23:50:59.746 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/15' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/31' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/36' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/20' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/12' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/39' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/10' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/34' 2020-04-02T23:50:59.747 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/38' 2020-04-02T23:50:59.748 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/11' 2020-04-02T23:50:59.748 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/16' 2020-04-02T23:50:59.748 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/32' 2020-04-02T23:50:59.748 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/30' 2020-04-02T23:50:59.748 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/14' 2020-04-02T23:50:59.748 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/18' 2020-04-02T23:50:59.748 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/13' 2020-04-02T23:50:59.749 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/33' 2020-04-02T23:50:59.749 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/17' 2020-04-02T23:50:59.749 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/35' 2020-04-02T23:50:59.749 INFO:tasks.workunit.client.0.smithi082.stdout:removed './123/37' 2020-04-02T23:50:59.749 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './123' 2020-04-02T23:50:59.749 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/19' 2020-04-02T23:50:59.750 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/15' 2020-04-02T23:50:59.750 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/31' 2020-04-02T23:50:59.750 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/36' 2020-04-02T23:50:59.750 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/20' 2020-04-02T23:50:59.750 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/12' 2020-04-02T23:50:59.751 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/39' 2020-04-02T23:50:59.751 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/10' 2020-04-02T23:50:59.751 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/34' 2020-04-02T23:50:59.751 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/38' 2020-04-02T23:50:59.751 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/11' 2020-04-02T23:50:59.751 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/16' 2020-04-02T23:50:59.751 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/32' 2020-04-02T23:50:59.752 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/30' 2020-04-02T23:50:59.752 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/14' 2020-04-02T23:50:59.752 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/18' 2020-04-02T23:50:59.752 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/13' 2020-04-02T23:50:59.752 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/33' 2020-04-02T23:50:59.752 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/17' 2020-04-02T23:50:59.752 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/35' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed './124/37' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './124' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/19' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/15' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/31' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/36' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/20' 2020-04-02T23:50:59.753 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/12' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/39' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/10' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/34' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/38' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/11' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/16' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/32' 2020-04-02T23:50:59.754 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/30' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/14' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/18' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/13' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/33' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/17' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/35' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed './125/37' 2020-04-02T23:50:59.755 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './125' 2020-04-02T23:50:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/19' 2020-04-02T23:50:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/15' 2020-04-02T23:50:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/31' 2020-04-02T23:50:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/36' 2020-04-02T23:50:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/20' 2020-04-02T23:50:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/12' 2020-04-02T23:50:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/39' 2020-04-02T23:50:59.757 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/10' 2020-04-02T23:50:59.757 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/34' 2020-04-02T23:50:59.757 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/38' 2020-04-02T23:50:59.757 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/11' 2020-04-02T23:50:59.757 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/16' 2020-04-02T23:50:59.757 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/32' 2020-04-02T23:50:59.758 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/30' 2020-04-02T23:50:59.758 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/14' 2020-04-02T23:50:59.758 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/18' 2020-04-02T23:50:59.758 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/13' 2020-04-02T23:50:59.758 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/33' 2020-04-02T23:50:59.758 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/17' 2020-04-02T23:50:59.758 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/35' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed './126/37' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './126' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/19' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/15' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/31' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/36' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/20' 2020-04-02T23:50:59.759 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/12' 2020-04-02T23:50:59.760 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/39' 2020-04-02T23:50:59.760 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/10' 2020-04-02T23:50:59.760 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/34' 2020-04-02T23:50:59.760 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/38' 2020-04-02T23:50:59.760 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/11' 2020-04-02T23:50:59.760 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/16' 2020-04-02T23:50:59.760 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/32' 2020-04-02T23:50:59.761 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/30' 2020-04-02T23:50:59.761 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/14' 2020-04-02T23:50:59.761 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/18' 2020-04-02T23:50:59.761 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/13' 2020-04-02T23:50:59.761 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/33' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/17' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/35' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed './127/37' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './127' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/19' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/15' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/31' 2020-04-02T23:50:59.762 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/36' 2020-04-02T23:50:59.763 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/20' 2020-04-02T23:50:59.763 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/12' 2020-04-02T23:50:59.763 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/39' 2020-04-02T23:50:59.763 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/10' 2020-04-02T23:50:59.763 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/34' 2020-04-02T23:50:59.763 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/38' 2020-04-02T23:50:59.763 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/11' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/16' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/32' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/30' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/14' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/18' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/13' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/33' 2020-04-02T23:50:59.764 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/17' 2020-04-02T23:50:59.765 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/35' 2020-04-02T23:51:04.133 INFO:tasks.workunit.client.0.smithi082.stdout:removed './128/37' 2020-04-02T23:51:04.133 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './128' 2020-04-02T23:51:04.133 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/19' 2020-04-02T23:51:04.134 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/15' 2020-04-02T23:51:04.134 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/31' 2020-04-02T23:51:04.134 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/36' 2020-04-02T23:51:04.134 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/20' 2020-04-02T23:51:04.134 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/12' 2020-04-02T23:51:04.134 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/39' 2020-04-02T23:51:04.135 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/10' 2020-04-02T23:51:04.135 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/34' 2020-04-02T23:51:04.135 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/38' 2020-04-02T23:51:04.135 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/11' 2020-04-02T23:51:04.135 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/16' 2020-04-02T23:51:04.135 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/32' 2020-04-02T23:51:04.136 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/30' 2020-04-02T23:51:04.136 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/14' 2020-04-02T23:51:04.136 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/18' 2020-04-02T23:51:04.136 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/13' 2020-04-02T23:51:04.136 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/33' 2020-04-02T23:51:04.136 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/17' 2020-04-02T23:51:04.136 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/35' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed './129/37' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './129' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/19' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/15' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/31' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/36' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/20' 2020-04-02T23:51:04.137 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/12' 2020-04-02T23:51:04.138 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/39' 2020-04-02T23:51:04.138 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/10' 2020-04-02T23:51:04.138 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/34' 2020-04-02T23:51:04.138 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/38' 2020-04-02T23:51:04.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/11' 2020-04-02T23:51:04.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/16' 2020-04-02T23:51:04.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/32' 2020-04-02T23:51:04.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/30' 2020-04-02T23:51:04.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/14' 2020-04-02T23:51:04.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/18' 2020-04-02T23:51:04.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/13' 2020-04-02T23:51:04.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/33' 2020-04-02T23:51:04.146 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/17' 2020-04-02T23:51:04.146 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/35' 2020-04-02T23:51:04.146 INFO:tasks.workunit.client.0.smithi082.stdout:removed './130/37' 2020-04-02T23:51:04.146 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './130' 2020-04-02T23:51:04.146 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/19' 2020-04-02T23:51:04.146 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/15' 2020-04-02T23:51:04.146 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/31' 2020-04-02T23:51:04.147 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/36' 2020-04-02T23:51:04.147 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/20' 2020-04-02T23:51:04.147 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/12' 2020-04-02T23:51:04.147 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/39' 2020-04-02T23:51:04.147 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/10' 2020-04-02T23:51:04.147 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/34' 2020-04-02T23:51:04.147 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/38' 2020-04-02T23:51:04.148 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/11' 2020-04-02T23:51:04.148 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/16' 2020-04-02T23:51:04.148 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/32' 2020-04-02T23:51:04.148 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/30' 2020-04-02T23:51:04.148 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/14' 2020-04-02T23:51:04.148 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/18' 2020-04-02T23:51:04.148 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/13' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/33' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/17' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/35' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed './131/37' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './131' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/19' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/15' 2020-04-02T23:51:04.149 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/31' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/36' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/20' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/12' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/39' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/10' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/34' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/38' 2020-04-02T23:51:04.150 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/11' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/16' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/32' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/30' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/14' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/18' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/13' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/33' 2020-04-02T23:51:04.151 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/17' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/35' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed './132/37' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './132' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/19' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/15' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/31' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/36' 2020-04-02T23:51:04.152 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/20' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/12' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/39' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/10' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/34' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/38' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/11' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/16' 2020-04-02T23:51:04.153 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/32' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/30' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/14' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/18' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/13' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/33' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/17' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/35' 2020-04-02T23:51:04.154 INFO:tasks.workunit.client.0.smithi082.stdout:removed './133/37' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './133' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/19' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/15' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/31' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/36' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/20' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/12' 2020-04-02T23:51:04.155 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/39' 2020-04-02T23:51:04.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/10' 2020-04-02T23:51:04.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/34' 2020-04-02T23:51:04.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/38' 2020-04-02T23:51:04.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/11' 2020-04-02T23:51:04.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/16' 2020-04-02T23:51:04.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/32' 2020-04-02T23:51:04.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/30' 2020-04-02T23:51:04.157 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/14' 2020-04-02T23:51:04.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/18' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/13' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/33' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/17' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/35' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './134/37' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './134' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/19' 2020-04-02T23:51:04.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/15' 2020-04-02T23:51:04.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/31' 2020-04-02T23:51:04.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/36' 2020-04-02T23:51:04.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/20' 2020-04-02T23:51:04.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/12' 2020-04-02T23:51:04.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/39' 2020-04-02T23:51:04.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/10' 2020-04-02T23:51:04.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/34' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/38' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/11' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/16' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/32' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/30' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/14' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/18' 2020-04-02T23:51:04.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/13' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/33' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/17' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/35' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './135/37' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './135' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/19' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/15' 2020-04-02T23:51:04.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/31' 2020-04-02T23:51:04.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/36' 2020-04-02T23:51:04.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/20' 2020-04-02T23:51:04.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/12' 2020-04-02T23:51:04.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/39' 2020-04-02T23:51:04.166 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/10' 2020-04-02T23:51:04.166 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/34' 2020-04-02T23:51:04.166 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/38' 2020-04-02T23:51:04.166 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/11' 2020-04-02T23:51:04.166 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/16' 2020-04-02T23:51:04.166 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/32' 2020-04-02T23:51:04.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/30' 2020-04-02T23:51:04.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/14' 2020-04-02T23:51:04.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/18' 2020-04-02T23:51:04.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/13' 2020-04-02T23:51:04.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/33' 2020-04-02T23:51:04.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/17' 2020-04-02T23:51:04.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/35' 2020-04-02T23:51:04.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './136/37' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './136' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/19' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/15' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/31' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/36' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/20' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/12' 2020-04-02T23:51:04.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/39' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/10' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/34' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/38' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/11' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/16' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/32' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/30' 2020-04-02T23:51:04.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/14' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/18' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/13' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/33' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/17' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/35' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './137/37' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './137' 2020-04-02T23:51:04.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/19' 2020-04-02T23:51:04.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/15' 2020-04-02T23:51:04.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/31' 2020-04-02T23:51:04.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/36' 2020-04-02T23:51:04.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/20' 2020-04-02T23:51:04.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/12' 2020-04-02T23:51:04.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/39' 2020-04-02T23:51:04.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/10' 2020-04-02T23:51:04.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/34' 2020-04-02T23:51:04.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/38' 2020-04-02T23:51:04.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/11' 2020-04-02T23:51:04.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/16' 2020-04-02T23:51:04.928 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/32' 2020-04-02T23:51:04.928 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/30' 2020-04-02T23:51:04.929 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/14' 2020-04-02T23:51:04.929 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/18' 2020-04-02T23:51:04.929 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/13' 2020-04-02T23:51:04.929 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/33' 2020-04-02T23:51:04.929 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/17' 2020-04-02T23:51:04.929 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/35' 2020-04-02T23:51:04.929 INFO:tasks.workunit.client.0.smithi082.stdout:removed './138/37' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './138' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/19' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/15' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/31' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/36' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/20' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/12' 2020-04-02T23:51:04.930 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/39' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/10' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/34' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/38' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/11' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/16' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/32' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/30' 2020-04-02T23:51:04.931 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/14' 2020-04-02T23:51:04.932 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/18' 2020-04-02T23:51:04.932 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/13' 2020-04-02T23:51:04.932 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/33' 2020-04-02T23:51:04.932 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/17' 2020-04-02T23:51:04.932 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/35' 2020-04-02T23:51:04.932 INFO:tasks.workunit.client.0.smithi082.stdout:removed './139/37' 2020-04-02T23:51:04.932 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './139' 2020-04-02T23:51:04.933 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/19' 2020-04-02T23:51:04.933 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/15' 2020-04-02T23:51:04.933 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/31' 2020-04-02T23:51:04.933 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/36' 2020-04-02T23:51:04.933 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/20' 2020-04-02T23:51:04.933 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/12' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/39' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/10' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/34' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/38' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/11' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/16' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/32' 2020-04-02T23:51:04.934 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/30' 2020-04-02T23:51:04.935 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/14' 2020-04-02T23:51:04.935 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/18' 2020-04-02T23:51:04.935 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/13' 2020-04-02T23:51:04.935 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/33' 2020-04-02T23:51:04.935 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/17' 2020-04-02T23:51:04.935 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/35' 2020-04-02T23:51:04.935 INFO:tasks.workunit.client.0.smithi082.stdout:removed './140/37' 2020-04-02T23:51:04.936 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './140' 2020-04-02T23:51:04.936 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/19' 2020-04-02T23:51:04.936 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/15' 2020-04-02T23:51:04.936 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/31' 2020-04-02T23:51:04.936 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/36' 2020-04-02T23:51:04.936 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/20' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/12' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/39' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/10' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/34' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/38' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/11' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/16' 2020-04-02T23:51:04.937 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/32' 2020-04-02T23:51:04.938 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/30' 2020-04-02T23:51:04.938 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/14' 2020-04-02T23:51:04.938 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/18' 2020-04-02T23:51:04.938 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/13' 2020-04-02T23:51:04.938 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/33' 2020-04-02T23:51:04.938 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/17' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/35' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed './141/37' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './141' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/19' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/15' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/31' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/36' 2020-04-02T23:51:04.939 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/20' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/12' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/39' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/10' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/34' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/38' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/11' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/16' 2020-04-02T23:51:04.940 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/32' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/30' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/14' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/18' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/13' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/33' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/17' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/35' 2020-04-02T23:51:04.941 INFO:tasks.workunit.client.0.smithi082.stdout:removed './142/37' 2020-04-02T23:51:04.942 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './142' 2020-04-02T23:51:04.942 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/19' 2020-04-02T23:51:04.942 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/15' 2020-04-02T23:51:04.942 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/31' 2020-04-02T23:51:04.942 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/36' 2020-04-02T23:51:04.942 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/20' 2020-04-02T23:51:04.942 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/12' 2020-04-02T23:51:04.943 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/39' 2020-04-02T23:51:04.943 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/10' 2020-04-02T23:51:04.944 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/34' 2020-04-02T23:51:04.944 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/38' 2020-04-02T23:51:04.944 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/11' 2020-04-02T23:51:04.944 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/16' 2020-04-02T23:51:04.944 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/32' 2020-04-02T23:51:04.944 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/30' 2020-04-02T23:51:04.944 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/14' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/18' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/13' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/33' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/17' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/35' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed './143/37' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './143' 2020-04-02T23:51:04.945 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/19' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/15' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/31' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/36' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/20' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/12' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/39' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/10' 2020-04-02T23:51:04.946 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/34' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/38' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/11' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/16' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/32' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/30' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/14' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/18' 2020-04-02T23:51:04.947 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/13' 2020-04-02T23:51:04.948 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/33' 2020-04-02T23:51:04.948 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/17' 2020-04-02T23:51:04.948 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/35' 2020-04-02T23:51:04.948 INFO:tasks.workunit.client.0.smithi082.stdout:removed './144/37' 2020-04-02T23:51:04.948 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './144' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/19' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/15' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/31' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/36' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/20' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/12' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/39' 2020-04-02T23:51:04.949 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/10' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/34' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/38' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/11' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/16' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/32' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/30' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/14' 2020-04-02T23:51:04.950 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/18' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/13' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/33' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/17' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/35' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed './145/37' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './145' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/19' 2020-04-02T23:51:04.951 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/15' 2020-04-02T23:51:04.952 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/31' 2020-04-02T23:51:04.952 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/36' 2020-04-02T23:51:04.952 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/20' 2020-04-02T23:51:04.952 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/12' 2020-04-02T23:51:04.952 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/39' 2020-04-02T23:51:04.952 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/10' 2020-04-02T23:51:04.952 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/34' 2020-04-02T23:51:04.953 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/38' 2020-04-02T23:51:04.953 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/11' 2020-04-02T23:51:04.953 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/16' 2020-04-02T23:51:04.953 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/32' 2020-04-02T23:51:04.953 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/30' 2020-04-02T23:51:04.953 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/14' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/18' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/13' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/33' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/17' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/35' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed './146/37' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './146' 2020-04-02T23:51:04.954 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/19' 2020-04-02T23:51:04.955 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/15' 2020-04-02T23:51:04.955 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/31' 2020-04-02T23:51:04.955 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/36' 2020-04-02T23:51:04.955 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/20' 2020-04-02T23:51:04.955 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/12' 2020-04-02T23:51:04.955 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/39' 2020-04-02T23:51:04.955 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/10' 2020-04-02T23:51:04.956 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/34' 2020-04-02T23:51:04.956 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/38' 2020-04-02T23:51:04.956 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/11' 2020-04-02T23:51:04.956 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/16' 2020-04-02T23:51:04.956 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/32' 2020-04-02T23:51:04.956 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/30' 2020-04-02T23:51:04.956 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/14' 2020-04-02T23:51:04.957 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/18' 2020-04-02T23:51:04.957 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/13' 2020-04-02T23:51:04.957 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/33' 2020-04-02T23:51:04.957 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/17' 2020-04-02T23:51:04.957 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/35' 2020-04-02T23:51:04.957 INFO:tasks.workunit.client.0.smithi082.stdout:removed './147/37' 2020-04-02T23:51:04.957 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './147' 2020-04-02T23:51:04.958 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/19' 2020-04-02T23:51:04.958 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/15' 2020-04-02T23:51:04.958 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/31' 2020-04-02T23:51:04.958 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/36' 2020-04-02T23:51:08.139 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/20' 2020-04-02T23:51:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/12' 2020-04-02T23:51:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/39' 2020-04-02T23:51:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/10' 2020-04-02T23:51:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/34' 2020-04-02T23:51:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/38' 2020-04-02T23:51:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/11' 2020-04-02T23:51:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/16' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/32' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/30' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/14' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/18' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/13' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/33' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/17' 2020-04-02T23:51:08.141 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/35' 2020-04-02T23:51:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:removed './148/37' 2020-04-02T23:51:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './148' 2020-04-02T23:51:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/19' 2020-04-02T23:51:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/15' 2020-04-02T23:51:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/31' 2020-04-02T23:51:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/36' 2020-04-02T23:51:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/20' 2020-04-02T23:51:08.143 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/12' 2020-04-02T23:51:08.143 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/39' 2020-04-02T23:51:08.143 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/10' 2020-04-02T23:51:08.143 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/34' 2020-04-02T23:51:08.143 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/38' 2020-04-02T23:51:08.143 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/11' 2020-04-02T23:51:08.144 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/16' 2020-04-02T23:51:08.144 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/32' 2020-04-02T23:51:08.144 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/30' 2020-04-02T23:51:08.144 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/14' 2020-04-02T23:51:08.144 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/18' 2020-04-02T23:51:08.144 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/13' 2020-04-02T23:51:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/33' 2020-04-02T23:51:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/17' 2020-04-02T23:51:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/35' 2020-04-02T23:51:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './149/37' 2020-04-02T23:51:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './149' 2020-04-02T23:51:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/19' 2020-04-02T23:51:08.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/15' 2020-04-02T23:51:08.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/31' 2020-04-02T23:51:08.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/36' 2020-04-02T23:51:08.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/20' 2020-04-02T23:51:08.156 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/12' 2020-04-02T23:51:08.157 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/39' 2020-04-02T23:51:08.157 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/10' 2020-04-02T23:51:08.157 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/34' 2020-04-02T23:51:08.157 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/38' 2020-04-02T23:51:08.157 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/11' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/16' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/32' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/30' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/14' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/18' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/13' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/33' 2020-04-02T23:51:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/17' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/35' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed './150/37' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './150' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/19' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/15' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/31' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/36' 2020-04-02T23:51:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/20' 2020-04-02T23:51:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/12' 2020-04-02T23:51:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/39' 2020-04-02T23:51:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/10' 2020-04-02T23:51:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/34' 2020-04-02T23:51:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/38' 2020-04-02T23:51:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/11' 2020-04-02T23:51:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/16' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/32' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/30' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/14' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/18' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/13' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/33' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/17' 2020-04-02T23:51:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/35' 2020-04-02T23:51:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './151/37' 2020-04-02T23:51:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './151' 2020-04-02T23:51:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/19' 2020-04-02T23:51:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/15' 2020-04-02T23:51:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/31' 2020-04-02T23:51:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/36' 2020-04-02T23:51:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/20' 2020-04-02T23:51:08.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/12' 2020-04-02T23:51:08.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/39' 2020-04-02T23:51:08.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/10' 2020-04-02T23:51:08.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/34' 2020-04-02T23:51:08.163 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/38' 2020-04-02T23:51:08.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/11' 2020-04-02T23:51:08.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/16' 2020-04-02T23:51:08.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/32' 2020-04-02T23:51:08.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/30' 2020-04-02T23:51:08.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/14' 2020-04-02T23:51:08.164 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/18' 2020-04-02T23:51:08.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/13' 2020-04-02T23:51:08.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/33' 2020-04-02T23:51:08.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/17' 2020-04-02T23:51:08.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/35' 2020-04-02T23:51:08.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './152/37' 2020-04-02T23:51:08.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './152' 2020-04-02T23:51:08.165 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/19' 2020-04-02T23:51:08.166 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/15' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/31' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/36' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/20' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/12' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/39' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/10' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/34' 2020-04-02T23:51:08.167 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/38' 2020-04-02T23:51:08.168 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/11' 2020-04-02T23:51:08.168 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/16' 2020-04-02T23:51:08.168 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/32' 2020-04-02T23:51:08.168 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/30' 2020-04-02T23:51:08.168 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/14' 2020-04-02T23:51:08.168 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/18' 2020-04-02T23:51:08.168 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/13' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/33' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/17' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/35' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './153/37' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './153' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/19' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/15' 2020-04-02T23:51:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/31' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/36' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/20' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/12' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/39' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/10' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/34' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/38' 2020-04-02T23:51:08.170 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/11' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/16' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/32' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/30' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/14' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/18' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/13' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/33' 2020-04-02T23:51:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/17' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/35' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './154/37' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './154' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/19' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/15' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/31' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/36' 2020-04-02T23:51:08.172 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/20' 2020-04-02T23:51:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/12' 2020-04-02T23:51:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/39' 2020-04-02T23:51:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/10' 2020-04-02T23:51:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/34' 2020-04-02T23:51:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/38' 2020-04-02T23:51:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/11' 2020-04-02T23:51:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/16' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/32' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/30' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/14' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/18' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/13' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/33' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/17' 2020-04-02T23:51:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/35' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed './155/37' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './155' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/19' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/15' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/31' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/36' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/20' 2020-04-02T23:51:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/12' 2020-04-02T23:51:08.176 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/39' 2020-04-02T23:51:08.176 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/10' 2020-04-02T23:51:08.176 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/34' 2020-04-02T23:51:08.176 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/38' 2020-04-02T23:51:08.176 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/11' 2020-04-02T23:51:08.176 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/16' 2020-04-02T23:51:08.177 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/32' 2020-04-02T23:51:08.177 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/30' 2020-04-02T23:51:08.177 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/14' 2020-04-02T23:51:08.177 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/18' 2020-04-02T23:51:08.177 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/13' 2020-04-02T23:51:08.177 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/33' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/17' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/35' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed './156/37' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed directory './156' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/19' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/15' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/31' 2020-04-02T23:51:08.178 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/36' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/20' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/12' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/39' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/10' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/34' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/38' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/11' 2020-04-02T23:51:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/16' 2020-04-02T23:51:08.180 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/32' 2020-04-02T23:51:08.180 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/30' 2020-04-02T23:51:08.180 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/14' 2020-04-02T23:51:08.180 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/18' 2020-04-02T23:51:08.180 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/13' 2020-04-02T23:51:08.180 INFO:tasks.workunit.client.0.smithi082.stdout:removed './157/33' 2020-04-02T23:51:08.879 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:51:08.893 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:51:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.040+0000 7f531c79e700 1 Processor -- start 2020-04-02T23:51:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.040+0000 7f531c79e700 1 -- start start 2020-04-02T23:51:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531c79e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53140aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531c79e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314136870 0x7f53140a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531c79e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140a5820 con 0x7f53140a4b70 2020-04-02T23:51:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531c79e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140a4130 con 0x7f5314136870 2020-04-02T23:51:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531c79e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140a43d0 con 0x7f53140a2ab0 2020-04-02T23:51:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531a53a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53140aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531a53a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53140aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56560/0 (socket says 172.21.15.82:56560) 2020-04-02T23:51:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531a53a700 1 -- 172.21.15.82:0/781732358 learned_addr learned my addr 172.21.15.82:0/781732358 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:51:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.041+0000 7f531ad3b700 1 --2- 172.21.15.82:0/781732358 >> v2:172.21.15.50:3300/0 conn(0x7f5314136870 0x7f53140a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 -- 172.21.15.82:0/781732358 >> v2:172.21.15.50:3300/0 conn(0x7f5314136870 msgr2=0x7f53140a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:51:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 --2- 172.21.15.82:0/781732358 >> v2:172.21.15.50:3300/0 conn(0x7f5314136870 0x7f53140a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 -- 172.21.15.82:0/781732358 >> v1:172.21.15.50:6789/0 conn(0x7f53140a4b70 legacy=0x7f5314136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 -- 172.21.15.82:0/781732358 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140a4670 con 0x7f53140a2ab0 2020-04-02T23:51:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 --2- 172.21.15.82:0/781732358 >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53140aae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 --2- 172.21.15.82:0/781732358 >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53140aae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 --2- 172.21.15.82:0/781732358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53140aae80 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).ready entity=mon.1 client_cookie=190eab0a3fc42be4 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 --2- 172.21.15.82:0/781732358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53140aae80 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f5319538700 1 -- 172.21.15.82:0/781732358 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5310011670 con 0x7f53140a2ab0 2020-04-02T23:51:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 --2- 172.21.15.82:0/781732358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53140aae80 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531a53a700 1 --2- 172.21.15.82:0/781732358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53140aae80 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f5319538700 1 -- 172.21.15.82:0/781732358 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53100117d0 con 0x7f53140a2ab0 2020-04-02T23:51:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f5319538700 1 -- 172.21.15.82:0/781732358 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5310011bb0 con 0x7f53140a2ab0 2020-04-02T23:51:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 -- 172.21.15.82:0/781732358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 msgr2=0x7f53140aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 --2- 172.21.15.82:0/781732358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53140aae80 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).stop 2020-04-02T23:51:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 -- 172.21.15.82:0/781732358 shutdown_connections 2020-04-02T23:51:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 --2- 172.21.15.82:0/781732358 >> v2:172.21.15.50:3300/0 conn(0x7f5314136870 0x7f53140a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 --2- 172.21.15.82:0/781732358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53140aae80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 -- 172.21.15.82:0/781732358 >> 172.21.15.82:0/781732358 conn(0x7f531409de60 msgr2=0x7f531409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 -- 172.21.15.82:0/781732358 shutdown_connections 2020-04-02T23:51:09.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.042+0000 7f531c79e700 1 -- 172.21.15.82:0/781732358 wait complete. 2020-04-02T23:51:09.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.043+0000 7f531c79e700 1 Processor -- start 2020-04-02T23:51:09.077 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.043+0000 7f531c79e700 1 -- start start 2020-04-02T23:51:09.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531c79e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53141381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:09.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531c79e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140a4b70 0x7f5314139c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:09.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531c79e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531413a0c0 con 0x7f5314136870 2020-04-02T23:51:09.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531c79e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140668b0 con 0x7f53140a4b70 2020-04-02T23:51:09.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531c79e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53141377f0 con 0x7f53140a2ab0 2020-04-02T23:51:09.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53141381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.078 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53141381d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56566/0 (socket says 172.21.15.82:56566) 2020-04-02T23:51:09.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531ad3b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5314136870 0x7f5314143260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56620/0 (socket says 172.21.15.82:56620) 2020-04-02T23:51:09.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 -- 172.21.15.82:0/3705831829 learned_addr learned my addr 172.21.15.82:0/3705831829 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:51:09.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f5319d39700 1 --2- 172.21.15.82:0/3705831829 >> v2:172.21.15.50:3300/0 conn(0x7f53140a4b70 0x7f5314139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 -- 172.21.15.82:0/3705831829 >> v2:172.21.15.50:3300/0 conn(0x7f53140a4b70 msgr2=0x7f5314139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> v2:172.21.15.50:3300/0 conn(0x7f53140a4b70 0x7f5314139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 -- 172.21.15.82:0/3705831829 >> v1:172.21.15.82:6789/0 conn(0x7f5314136870 legacy=0x7f5314143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.079 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729885311 0 0) 0x7f530c001210 con 0x7f5314136870 2020-04-02T23:51:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 -- 172.21.15.82:0/3705831829 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314137a90 con 0x7f53140a2ab0 2020-04-02T23:51:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.044+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> v2:172.21.15.82:3300/0 conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5310011c70 con 0x7f53140a2ab0 2020-04-02T23:51:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310011e20 con 0x7f53140a2ab0 2020-04-02T23:51:09.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5314137d30 con 0x7f53140a2ab0 2020-04-02T23:51:09.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5310007530 con 0x7f53140a2ab0 2020-04-02T23:51:09.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53140a2470 con 0x7f53140a2ab0 2020-04-02T23:51:09.081 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.045+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.082 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f53100056c0 con 0x7f53140a2ab0 2020-04-02T23:51:09.082 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.082 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314056c50 con 0x7f53140a2ab0 2020-04-02T23:51:09.082 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f53037fe700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 0x7f52f4051af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:09.082 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f5310061440 con 0x7f53140a2ab0 2020-04-02T23:51:09.082 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f5319d39700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 0x7f52f4051af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.082 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f5319d39700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 0x7f52f4051af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f531405f560 tx=0x7f530400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.046+0000 7f5319d39700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 0x7f52f4051af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f531405f560 tx=0x7f530400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.047+0000 7f5319d39700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 0x7f52f4051af0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f531405f560 tx=0x7f530400c820).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:09.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.050+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.083 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.050+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f531003cbe0 con 0x7f53140a2ab0 2020-04-02T23:51:09.247 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.245+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f531405d150 con 0x7f53140a2ab0 2020-04-02T23:51:09.247 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.245+0000 7f531a53a700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.245+0000 7f53037fe700 1 -- 172.21.15.82:0/3705831829 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f5310040200 con 0x7f53140a2ab0 2020-04-02T23:51:09.248 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:51:09.248 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.82:6835/1743311703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1743311703},{"type":"v1","addr":"172.21.15.82:6835","nonce":1743311703}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:51:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.246+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 msgr2=0x7f52f4051af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.246+0000 7f531c79e700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 0x7f52f4051af0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f531405f560 tx=0x7f530400c820).stop 2020-04-02T23:51:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.246+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 msgr2=0x7f53141381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.246+0000 7f531c79e700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f5310002f30 tx=0x7f5310007a40).stop 2020-04-02T23:51:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.246+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 shutdown_connections 2020-04-02T23:51:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.246+0000 7f531c79e700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f52f404f630 0x7f52f4051af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.247+0000 7f531c79e700 1 --2- 172.21.15.82:0/3705831829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53140a2ab0 0x7f53141381d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.247+0000 7f531c79e700 1 --2- 172.21.15.82:0/3705831829 >> v2:172.21.15.50:3300/0 conn(0x7f53140a4b70 0x7f5314139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.247+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 >> 172.21.15.82:0/3705831829 conn(0x7f531409de60 msgr2=0x7f5314068640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.247+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 shutdown_connections 2020-04-02T23:51:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.247+0000 7f531c79e700 1 -- 172.21.15.82:0/3705831829 wait complete. 2020-04-02T23:51:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2020-04-02T23:51:09.259 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=0) 2020-04-02T23:51:09.259 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-02T23:51:09.260 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:51:09.269 INFO:tasks.ceph.mds.b:Stopped 2020-04-02T23:51:09.269 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:51:09.283 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:51:09.427 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.425+0000 7fde14418700 1 Processor -- start 2020-04-02T23:51:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.426+0000 7fde14418700 1 -- start start 2020-04-02T23:51:09.434 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.426+0000 7fde14418700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde0c0a2ab0 0x7fde0c0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:09.434 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.426+0000 7fde14418700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:09.434 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.426+0000 7fde14418700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0a5820 con 0x7fde0c136160 2020-04-02T23:51:09.434 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.426+0000 7fde14418700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0a4130 con 0x7fde0c0a4b70 2020-04-02T23:51:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.426+0000 7fde14418700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0a43d0 con 0x7fde0c0a2ab0 2020-04-02T23:51:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde129b5700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fde0c136160 0x7fde0c1365f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56632/0 (socket says 172.21.15.82:56632) 2020-04-02T23:51:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde129b5700 1 -- 172.21.15.82:0/271931194 learned_addr learned my addr 172.21.15.82:0/271931194 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:51:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde121b4700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde0c0a2ab0 0x7fde0c0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 -- 172.21.15.82:0/271931194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde0c0a2ab0 msgr2=0x7fde0c0aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:51:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde0c0a2ab0 0x7fde0c0aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 -- 172.21.15.82:0/271931194 >> v1:172.21.15.82:6789/0 conn(0x7fde0c136160 legacy=0x7fde0c1365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 -- 172.21.15.82:0/271931194 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0a4670 con 0x7fde0c0a4b70 2020-04-02T23:51:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde111b2700 1 -- 172.21.15.82:0/271931194 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451723390 0 0) 0x7fde0c0a5820 con 0x7fde0c136160 2020-04-02T23:51:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- 172.21.15.82:0/271931194 >> v2:172.21.15.82:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- 172.21.15.82:0/271931194 >> v2:172.21.15.82:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).ready entity=mon.1 client_cookie=26c0e25ee798b783 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde111b2700 1 -- 172.21.15.82:0/271931194 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde080113c0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde119b3700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde111b2700 1 -- 172.21.15.82:0/271931194 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08011520 con 0x7fde0c0a4b70 2020-04-02T23:51:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde111b2700 1 -- 172.21.15.82:0/271931194 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde08011900 con 0x7fde0c0a4b70 2020-04-02T23:51:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde14418700 1 -- 172.21.15.82:0/271931194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde0c0a4b70 msgr2=0x7fde0c0a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.427+0000 7fde14418700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).stop 2020-04-02T23:51:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.428+0000 7fde14418700 1 -- 172.21.15.82:0/271931194 shutdown_connections 2020-04-02T23:51:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.428+0000 7fde14418700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde0c0a2ab0 0x7fde0c0aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.428+0000 7fde14418700 1 --2- 172.21.15.82:0/271931194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a4ff0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.428+0000 7fde14418700 1 -- 172.21.15.82:0/271931194 >> 172.21.15.82:0/271931194 conn(0x7fde0c09de60 msgr2=0x7fde0c09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.428+0000 7fde14418700 1 -- 172.21.15.82:0/271931194 shutdown_connections 2020-04-02T23:51:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.428+0000 7fde14418700 1 -- 172.21.15.82:0/271931194 wait complete. 2020-04-02T23:51:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde14418700 1 Processor -- start 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde14418700 1 -- start start 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde14418700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde14418700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c066e80 con 0x7fde0c0a2ab0 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde14418700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c062b90 con 0x7fde0c136160 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde14418700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0616f0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde129b5700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fde0c136160 0x7fde0c14e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56638/0 (socket says 172.21.15.82:56638) 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde129b5700 1 -- 172.21.15.82:0/1458621312 learned_addr learned my addr 172.21.15.82:0/1458621312 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:51:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> v2:172.21.15.50:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158178523 0 0) 0x7fde0c062b90 con 0x7fde0c136160 2020-04-02T23:51:09.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.429+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddec002fe0 con 0x7fde0c136160 2020-04-02T23:51:09.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 -- 172.21.15.82:0/1458621312 >> v1:172.21.15.82:6789/0 conn(0x7fde0c136160 legacy=0x7fde0c14e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 -- 172.21.15.82:0/1458621312 >> v1:172.21.15.50:6789/0 conn(0x7fde0c0a2ab0 legacy=0x7fde0c062fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 -- 172.21.15.82:0/1458621312 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c061990 con 0x7fde0c0a4b70 2020-04-02T23:51:09.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> v2:172.21.15.50:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.440 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> v2:172.21.15.50:3300/0 conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:09.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde08011980 con 0x7fde0c0a4b70 2020-04-02T23:51:09.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08007150 con 0x7fde0c0a4b70 2020-04-02T23:51:09.441 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c0a0150 con 0x7fde0c0a4b70 2020-04-02T23:51:09.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde080074b0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c0a1ff0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.430+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.431+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fde080056c0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.431+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.431+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c0a0cf0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.442 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.431+0000 7fddfb7fe700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 0x7fddec04fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:09.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.431+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fde08061710 con 0x7fde0c0a4b70 2020-04-02T23:51:09.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.431+0000 7fde121b4700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 0x7fddec04fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:09.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.432+0000 7fde121b4700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 0x7fddec04fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde0c0a0080 tx=0x7fddfc007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.432+0000 7fde121b4700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 0x7fddec04fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde0c0a0080 tx=0x7fddfc007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.432+0000 7fde121b4700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 0x7fddec04fd60 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fde0c0a0080 tx=0x7fddfc007700).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:09.443 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.435+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.444 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.435+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fde0c0a0cf0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.620 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.618+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde0c0a0cf0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.619+0000 7fde119b3700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.619+0000 7fddfb7fe700 1 -- 172.21.15.82:0/1458621312 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fde0c0a0cf0 con 0x7fde0c0a4b70 2020-04-02T23:51:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:51:09.621 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.82:6835/1743311703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1743311703},{"type":"v1","addr":"172.21.15.82:6835","nonce":1743311703}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:51:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 msgr2=0x7fddec04fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 0x7fddec04fd60 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fde0c0a0080 tx=0x7fddfc007700).stop 2020-04-02T23:51:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 msgr2=0x7fde0c0a0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fde08002f30 tx=0x7fde08007a40).stop 2020-04-02T23:51:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 shutdown_connections 2020-04-02T23:51:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7fddec04d8a0 0x7fddec04fd60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 --2- 172.21.15.82:0/1458621312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde0c0a4b70 0x7fde0c0a0fb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 >> 172.21.15.82:0/1458621312 conn(0x7fde0c09de60 msgr2=0x7fde0c1356b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:09.624 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 shutdown_connections 2020-04-02T23:51:09.624 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:09.620+0000 7fde14418700 1 -- 172.21.15.82:0/1458621312 wait complete. 2020-04-02T23:51:09.624 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2020-04-02T23:51:09.632 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2020-04-02T23:51:11.633 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:51:11.649 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:51:11.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.804+0000 7f5c9c3c9700 1 Processor -- start 2020-04-02T23:51:11.806 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.804+0000 7f5c9c3c9700 1 -- start start 2020-04-02T23:51:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.804+0000 7f5c9c3c9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c940a49a0 0x7f5c9413a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.804+0000 7f5c9c3c9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94141370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9c3c9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940a2200 con 0x7f5c9413a490 2020-04-02T23:51:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9c3c9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c940a6650 con 0x7f5c940a49a0 2020-04-02T23:51:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9c3c9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940a7250 con 0x7f5c94137950 2020-04-02T23:51:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c940a49a0 0x7f5c9413a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c940a49a0 0x7f5c9413a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56602/0 (socket says 172.21.15.82:56602) 2020-04-02T23:51:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 -- 172.21.15.82:0/2464251151 learned_addr learned my addr 172.21.15.82:0/2464251151 (peer_addr_for_me v2:172.21.15.82:0/0) 2020-04-02T23:51:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a966700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 -- 172.21.15.82:0/2464251151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 msgr2=0x7f5c94141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:51:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 -- 172.21.15.82:0/2464251151 >> v1:172.21.15.50:6789/0 conn(0x7f5c9413a490 legacy=0x7f5c94137240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 -- 172.21.15.82:0/2464251151 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94066d20 con 0x7f5c940a49a0 2020-04-02T23:51:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- 172.21.15.82:0/2464251151 >> v2:172.21.15.82:3300/0 conn(0x7f5c940a49a0 0x7f5c9413a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c8c0032b0 tx=0x7f5c8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- 172.21.15.82:0/2464251151 >> v2:172.21.15.82:3300/0 conn(0x7f5c940a49a0 0x7f5c9413a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c8c0032b0 tx=0x7f5c8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a49a0 0x7f5c9413a030 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c007dc0).ready entity=mon.1 client_cookie=cd77ddfebb42ca50 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a49a0 0x7f5c9413a030 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c99163700 1 -- 172.21.15.82:0/2464251151 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c00a160 con 0x7f5c940a49a0 2020-04-02T23:51:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a49a0 0x7f5c9413a030 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9a165700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a49a0 0x7f5c9413a030 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c99163700 1 -- 172.21.15.82:0/2464251151 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00a2c0 con 0x7f5c940a49a0 2020-04-02T23:51:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c99163700 1 -- 172.21.15.82:0/2464251151 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c00a6e0 con 0x7f5c940a49a0 2020-04-02T23:51:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/2464251151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a49a0 msgr2=0x7f5c9413a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.805+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a49a0 0x7f5c9413a030 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c007dc0).stop 2020-04-02T23:51:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.806+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/2464251151 shutdown_connections 2020-04-02T23:51:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.806+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.806+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/2464251151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a49a0 0x7f5c9413a030 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:11.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.806+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/2464251151 >> 172.21.15.82:0/2464251151 conn(0x7f5c9409de60 msgr2=0x7f5c9409e270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:11.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.806+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/2464251151 shutdown_connections 2020-04-02T23:51:11.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.806+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/2464251151 wait complete. 2020-04-02T23:51:11.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9c3c9700 1 Processor -- start 2020-04-02T23:51:11.813 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9c3c9700 1 -- start start 2020-04-02T23:51:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9c3c9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9c3c9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c940a10b0 0x7f5c941316b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9c3c9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c94066f70 con 0x7f5c940a49a0 2020-04-02T23:51:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9c3c9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9413a1b0 con 0x7f5c940a10b0 2020-04-02T23:51:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9c3c9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941390d0 con 0x7f5c94137950 2020-04-02T23:51:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9a165700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5c940a49a0 0x7f5c9409f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56656/0 (socket says 172.21.15.82:56656) 2020-04-02T23:51:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.807+0000 7f5c9a165700 1 -- 172.21.15.82:0/1742521573 learned_addr learned my addr 172.21.15.82:0/1742521573 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:51:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> v2:172.21.15.82:3300/0 conn(0x7f5c940a10b0 0x7f5c941316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c99964700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 -- 172.21.15.82:0/1742521573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 msgr2=0x7f5c94131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94131250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 -- 172.21.15.82:0/1742521573 >> v1:172.21.15.82:6789/0 conn(0x7f5c940a49a0 legacy=0x7f5c9409f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158465034 0 0) 0x7f5c94066f70 con 0x7f5c940a49a0 2020-04-02T23:51:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 -- 172.21.15.82:0/1742521573 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940a0040 con 0x7f5c940a10b0 2020-04-02T23:51:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> v2:172.21.15.82:3300/0 conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> v2:172.21.15.82:3300/0 conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c90007530 con 0x7f5c940a10b0 2020-04-02T23:51:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c900056c0 con 0x7f5c940a10b0 2020-04-02T23:51:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c90005aa0 con 0x7f5c940a10b0 2020-04-02T23:51:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c94139570 con 0x7f5c940a10b0 2020-04-02T23:51:11.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.808+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c94131b10 con 0x7f5c940a10b0 2020-04-02T23:51:11.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.809+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.809+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5c90005d10 con 0x7f5c940a10b0 2020-04-02T23:51:11.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.809+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.809+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c94056c50 con 0x7f5c940a10b0 2020-04-02T23:51:11.820 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.809+0000 7f5c837fe700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 0x7f5c7404f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:11.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.809+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f5c9000d0c0 con 0x7f5c940a10b0 2020-04-02T23:51:11.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.810+0000 7f5c9a165700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 0x7f5c7404f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:11.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.810+0000 7f5c9a165700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 0x7f5c7404f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c8c0086a0 tx=0x7f5c8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.810+0000 7f5c9a165700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 0x7f5c7404f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c8c0086a0 tx=0x7f5c8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.810+0000 7f5c9a165700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 0x7f5c7404f8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f5c8c0086a0 tx=0x7f5c8c007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:11.821 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.813+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.822 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.813+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f5c9003c750 con 0x7f5c940a10b0 2020-04-02T23:51:11.996 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.994+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c940a6c30 con 0x7f5c940a10b0 2020-04-02T23:51:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.995+0000 7f5c9a966700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.995+0000 7f5c837fe700 1 -- 172.21.15.82:0/1742521573 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f5c9003fd70 con 0x7f5c940a10b0 2020-04-02T23:51:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:51:11.998 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.82:6835/1743311703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1743311703},{"type":"v1","addr":"172.21.15.82:6835","nonce":1743311703}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:51:11.999 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 msgr2=0x7f5c7404f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:11.999 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 0x7f5c7404f8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f5c8c0086a0 tx=0x7f5c8c007dc0).stop 2020-04-02T23:51:11.999 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 msgr2=0x7f5c941316b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:11.999 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f5c90002f30 tx=0x7f5c90010b40).stop 2020-04-02T23:51:11.999 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 shutdown_connections 2020-04-02T23:51:11.999 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c940a10b0 0x7f5c941316b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:12.000 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f5c7404d420 0x7f5c7404f8e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:12.000 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 --2- 172.21.15.82:0/1742521573 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c94137950 0x7f5c94131250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:12.000 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 >> 172.21.15.82:0/1742521573 conn(0x7f5c9409de60 msgr2=0x7f5c94137010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:12.000 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 shutdown_connections 2020-04-02T23:51:12.000 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:11.996+0000 7f5c9c3c9700 1 -- 172.21.15.82:0/1742521573 wait complete. 2020-04-02T23:51:12.000 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2020-04-02T23:51:12.008 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2020-04-02T23:51:14.009 INFO:teuthology.orchestra.run.smithi082:> true 2020-04-02T23:51:14.025 INFO:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:51:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.179+0000 7f41a1474700 1 Processor -- start 2020-04-02T23:51:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.179+0000 7f41a1474700 1 -- start start 2020-04-02T23:51:14.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f41a1474700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 0x7f419c060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:14.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f41a1474700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c140970 0x7f419c142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:14.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f41a1474700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c0628e0 con 0x7f419c05c3a0 2020-04-02T23:51:14.191 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f41a1474700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0a95a0 con 0x7f419c140970 2020-04-02T23:51:14.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f41a1474700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c062b10 con 0x7f419c05f730 2020-04-02T23:51:14.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f419affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f419c05c3a0 0x7f419c05f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56666/0 (socket says 172.21.15.82:56666) 2020-04-02T23:51:14.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f419affd700 1 -- 172.21.15.82:0/4221059734 learned_addr learned my addr 172.21.15.82:0/4221059734 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:51:14.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> v2:172.21.15.50:3300/0 conn(0x7f419c140970 0x7f419c142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f419a7fc700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 0x7f419c060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.192 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549974686 0 0) 0x7f419c0628e0 con 0x7f419c05c3a0 2020-04-02T23:51:14.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f417c003230 con 0x7f419c05c3a0 2020-04-02T23:51:14.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3037972498 0 0) 0x7f417c003230 con 0x7f419c05c3a0 2020-04-02T23:51:14.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 msgr2=0x7f419c060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:51:14.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 0x7f419c060cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:14.193 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 >> v2:172.21.15.50:3300/0 conn(0x7f419c140970 msgr2=0x7f419c142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:51:14.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 --2- 172.21.15.82:0/4221059734 >> v2:172.21.15.50:3300/0 conn(0x7f419c140970 0x7f419c142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:14.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.180+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0a9770 con 0x7f419c05c3a0 2020-04-02T23:51:14.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 899551024 0 0) 0x7f41840016d0 con 0x7f419c05c3a0 2020-04-02T23:51:14.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 >> v1:172.21.15.82:6789/0 conn(0x7f419c05c3a0 legacy=0x7f419c05f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:14.194 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c003720 0x7f417c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:14.195 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 0x7f417c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:14.195 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:51:14.196 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c062b10 con 0x7f417c003720 2020-04-02T23:51:14.196 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c005300 con 0x7f417c004930 2020-04-02T23:51:14.196 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0040f0 con 0x7f419c05f730 2020-04-02T23:51:14.196 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.196 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419affd700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c003720 0x7f417c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.197 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419a7fc700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 0x7f417c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.197 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 -- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 msgr2=0x7f417c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:51:14.197 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f419c05f730 0x7f417c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:14.197 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 -- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c003720 msgr2=0x7f417c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:51:14.197 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c003720 0x7f417c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:51:14.197 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 -- 172.21.15.82:0/4221059734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c003230 con 0x7f417c004930 2020-04-02T23:51:14.197 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41940032b0 tx=0x7f41940103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41940032b0 tx=0x7f41940103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f41940032b0 tx=0x7f41940103a0).ready entity=mon.1 client_cookie=822632372ac1cc2 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:14.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f41940032b0 tx=0x7f41940103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41940110c0 con 0x7f417c004930 2020-04-02T23:51:14.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f41940032b0 tx=0x7f41940103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4194011220 con 0x7f417c004930 2020-04-02T23:51:14.198 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f41940032b0 tx=0x7f41940103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f4199ffb700 1 -- 172.21.15.82:0/4221059734 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4194011600 con 0x7f417c004930 2020-04-02T23:51:14.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f41a1474700 1 -- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 msgr2=0x7f417c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:14.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f41a1474700 1 --2- 172.21.15.82:0/4221059734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c004930 0x7f417c004db0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f41940032b0 tx=0x7f41940103a0).stop 2020-04-02T23:51:14.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.181+0000 7f419b7fe700 1 -- 172.21.15.82:0/4221059734 reap_dead start 2020-04-02T23:51:14.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.182+0000 7f41a1474700 1 -- 172.21.15.82:0/4221059734 shutdown_connections 2020-04-02T23:51:14.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.182+0000 7f41a1474700 1 -- 172.21.15.82:0/4221059734 >> 172.21.15.82:0/4221059734 conn(0x7f419c0aa630 msgr2=0x7f419c0ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:14.199 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.182+0000 7f41a1474700 1 -- 172.21.15.82:0/4221059734 shutdown_connections 2020-04-02T23:51:14.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.182+0000 7f41a1474700 1 -- 172.21.15.82:0/4221059734 wait complete. 2020-04-02T23:51:14.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f41a1474700 1 Processor -- start 2020-04-02T23:51:14.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f41a1474700 1 -- start start 2020-04-02T23:51:14.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f41a1474700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f419c064c70 0x7f419c0a2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:14.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f41a1474700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c0a09a0 0x7f419c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:14.200 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f41a1474700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c0a0df0 con 0x7f419c1463f0 2020-04-02T23:51:14.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f41a1474700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c149cd0 con 0x7f419c0a09a0 2020-04-02T23:51:14.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f41a1474700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c149f70 con 0x7f419c064c70 2020-04-02T23:51:14.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f419affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f419c064c70 0x7f419c0a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.201 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f419a7fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f419c1463f0 0x7f419c0a0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56678/0 (socket says 172.21.15.82:56678) 2020-04-02T23:51:14.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f419a7fc700 1 -- 172.21.15.82:0/2628232429 learned_addr learned my addr 172.21.15.82:0/2628232429 (peer_addr_for_me v1:172.21.15.82:0/0) 2020-04-02T23:51:14.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.183+0000 7f419b7fe700 1 --2- 172.21.15.82:0/2628232429 >> v2:172.21.15.50:3300/0 conn(0x7f419c0a09a0 0x7f419c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 -- 172.21.15.82:0/2628232429 >> v2:172.21.15.50:3300/0 conn(0x7f419c0a09a0 msgr2=0x7f419c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:14.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> v2:172.21.15.50:3300/0 conn(0x7f419c0a09a0 0x7f419c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:14.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 -- 172.21.15.82:0/2628232429 >> v1:172.21.15.82:6789/0 conn(0x7f419c1463f0 legacy=0x7f419c0a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:14.202 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13781774 0 0) 0x7f419c0a0df0 con 0x7f419c1463f0 2020-04-02T23:51:14.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 -- 172.21.15.82:0/2628232429 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c14a210 con 0x7f419c064c70 2020-04-02T23:51:14.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> v2:172.21.15.82:3300/0 conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> v2:172.21.15.82:3300/0 conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:14.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4184012c40 con 0x7f419c064c70 2020-04-02T23:51:14.203 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.204 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.204 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4184012da0 con 0x7f419c064c70 2020-04-02T23:51:14.204 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c1499c0 con 0x7f419c064c70 2020-04-02T23:51:14.204 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f418400c9f0 con 0x7f419c064c70 2020-04-02T23:51:14.204 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.184+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c14a6b0 con 0x7f419c064c70 2020-04-02T23:51:14.204 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.185+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.205 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.185+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f418400cc60 con 0x7f419c064c70 2020-04-02T23:51:14.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.185+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c14a3a0 con 0x7f419c064c70 2020-04-02T23:51:14.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.185+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.185+0000 7f4193fff700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 0x7f418004f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:51:14.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.185+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f4184061260 con 0x7f419c064c70 2020-04-02T23:51:14.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.185+0000 7f419a7fc700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 0x7f418004f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:51:14.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.186+0000 7f419a7fc700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 0x7f418004f8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f418c002ed0 tx=0x7f418c00c930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.206 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.186+0000 7f419a7fc700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 0x7f418004f8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f418c002ed0 tx=0x7f418c00c930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.186+0000 7f419a7fc700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 0x7f418004f8d0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f418c002ed0 tx=0x7f418c00c930).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:51:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.189+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.189+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f418403c9c0 con 0x7f419c064c70 2020-04-02T23:51:14.372 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.369+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f419c056c50 con 0x7f419c064c70 2020-04-02T23:51:14.372 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.369+0000 7f419affd700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:51:14.372 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.369+0000 7f4193fff700 1 -- 172.21.15.82:0/2628232429 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f418403ffe0 con 0x7f419c064c70 2020-04-02T23:51:14.373 INFO:teuthology.orchestra.run.smithi082.stdout: 2020-04-02T23:51:14.373 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.82:6835/1743311703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1743311703},{"type":"v1","addr":"172.21.15.82:6835","nonce":1743311703}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-04-02T23:47:03.694261+0000","modified":"2020-04-02T23:49:38.573827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":42,"addr":"172.21.15.50:6833/2390920466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2390920466},{"type":"v1","addr":"172.21.15.50:6833","nonce":2390920466}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:51:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.370+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 msgr2=0x7f418004f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.370+0000 7f41a1474700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 0x7f418004f8d0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f418c002ed0 tx=0x7f418c00c930).stop 2020-04-02T23:51:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.370+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 msgr2=0x7f419c0a2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:51:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.370+0000 7f41a1474700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f41840013e0 tx=0x7f419c0a9900).stop 2020-04-02T23:51:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.371+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 shutdown_connections 2020-04-02T23:51:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.371+0000 7f41a1474700 1 --2- 172.21.15.82:0/2628232429 >> v2:172.21.15.50:3300/0 conn(0x7f419c0a09a0 0x7f419c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.371+0000 7f41a1474700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c064c70 0x7f419c0a2820 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.371+0000 7f41a1474700 1 --2- 172.21.15.82:0/2628232429 >> [v2:172.21.15.82:6800/23559,v1:172.21.15.82:6801/23559] conn(0x7f418004d410 0x7f418004f8d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:51:14.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.371+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 >> 172.21.15.82:0/2628232429 conn(0x7f419c0aa630 msgr2=0x7f419c0ab770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:51:14.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.371+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 shutdown_connections 2020-04-02T23:51:14.376 INFO:teuthology.orchestra.run.smithi082.stderr:2020-04-02T23:51:14.371+0000 7f41a1474700 1 -- 172.21.15.82:0/2628232429 wait complete. 2020-04-02T23:51:14.376 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2020-04-02T23:51:14.383 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2020-04-02T23:51:15.743 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-02T23:51:15.743 DEBUG:teuthology.task.console_log:Killing console logger for smithi050 2020-04-02T23:51:15.744 DEBUG:teuthology.task.console_log:Killing console logger for smithi082 2020-04-02T23:51:15.744 DEBUG:teuthology.task.console_log:Killing console logger for smithi050 2020-04-02T23:51:15.744 DEBUG:teuthology.task.console_log:Killing console logger for smithi082 2020-04-02T23:51:15.744 DEBUG:teuthology.exit:Finished running handlers